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AN 

ASSESSMENT OF THE VALIDITY AND RELIABILITY OF THE 
INSTITUTIONAL PERFORMANCE SURVEY 

Executive Summary 
The Institutional Performance Survey (IPS) is the by-product 
of a national research study whose primary intent was to assess 
how various institutional conditions were related to an 
institution's external environment, strategic competence, and 
effectiveness. After the IPS was used in the national study many 
institutions sought to purchase the instrument for self-study 
purposes. The intent of the current effort is to assesss the 
validity and reliability of the IPS with respect to its use as 
an institutional self -study instrument. 

Psychometric Assessment 
The validity of an instrument reflects the accuracy with 
which meaningful and relevant measurement can be made with it in 
the sense that it actually measures the traits it was intended to 
measure. For every validation procedure the essential question 
is: for whom and for what purpose is the test to be valid. 
Several different types of -validity" are discussed in the 
psychometric literature. Four shall be assessed in this 
evaluation: content, face, construct, and concurrent. 

Content Validity 

Content validity is concerned with the adequacy of sampling 
from the domain or domains an instrument purports to measure. In 
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assessing the content validity of the IPS we are confronted by its 
dual roles — first as a research tool, and second as a diagnostic 
or assessment instrument for institutional managers. This 
assessment focuses on its latter role. 

Unfortunately, existing research offers little guidance 
regarding the criteria that should be employed (that is, that are 
appropriate and essential) to judge the content validity of a 
college and university self-study instrument. Hence, in order to 
evaluate this form of validity the investigation was forced to 
compare the IPS with instruments whose purposes were tangentially 
related to the IPS. 

The results of these comparisons suggest that the IPS 
measures a great number of the dimensions or constructs that other 
instruments view as important to institutional self -study. The 
IPS also appears to assess dimensions not tapped by other 
instruments. These include perceptions of 1) competition, 2) 
enrollment and revenue conditions, 3) resource allocation, and 4) 
institutional functioning — specifically, investor confidence, 
reallocation priorities, and slack resources. At the same time, 
however, the results of the comparisons suggest that the IPS is 
not measuring a number of dimensions that other instruments view 
as important. At the most general level, these include: 

(1) The assessment of educational outcomes. This type of 
assessment generally entails some form of student 
evaluation. 
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(2) The assessment of educational climate. Again, this type 
of assessment generally entails some form of student 
evaluation . 

(3) The assessment of relations between members of different 
groups—for example, between faculty and their 
department chair; or, between department chairs/deans 
and the president. 

(4) The assessment of both current conditions and desired 
conditions . 

(5) The assessment of institutional public service and 
research goals. 

(6) The assessment of productivity and efficiency. 



Face Validity 

The face validity of a test is concerned with what it appears 
to measure, not with what it actually measures. Face validity is 
essential because without it, a test is unlikely to be purchased, 
employed, or rjiven serious consideration by respondents. Three 
meanings have been attributed to face validity: 1) validity by 
definition, 2) validity by assumption, and 3) validity by 
appearance. 

A test is considered to be velid by definition if the sample 
of items appear to the subject-matter expert to adequately 
represent the total universe of appropriate questions. Tne IPS 
appears to fall short on this criterion— it was not reviewed by 
anyone outside of NCHEMS. On the other hand, as previously noted 
in the discussion of the instrument's content validity, the 
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appropriate domain of institutional self-study is neither 
empirically defined, nor agreed upon. This makes it difficult to 
obtain subject-matter experts to review the instrument. 

Validity by assumption requires that the items of the 
instrument bear a "common-sense" relationship to the objective of 
the test. The validity of the IPS on this criterion was assessed 
by interviewing faculty and administrators at five institutions 
regarding their interpretations and assessment of the instrument. 
Their comments generally suggest that most of the questions were 
interpreted as intended. However, several problems appear to 
attend both the language and construction of the instrument. 

Included among their criticisms wan the use of jargon, 
failure to include a "Don't Know" response category, the use of 
ambiguous language, and the point assignment format for Section 5 
(Type of Institution). 

The appearance of validity criterion is primarily concerned 
with the extent to which an instrument appears practical, 
pertinent, and related to its intended uses. Judgment may be 
based on the extent to which consumers believe the instrument 
meets their information needs and respondents feel that it is a 
worthwhile investment of their time and the institution's money. 
The IPS's primary consumer is the top administrative team and 
persons delegated by them to carry out the study. A second and 
overlapping set of consumers xnvolves those charged with acting on 
the results of the study. 

Comments included with respondents' questionnaires and those 
solicited during interviews yield mixed perceptions regarding the 
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quality of the instrument. However, the primary issue raised by 
respondents was not the quality of the instrument, but with what 
was to be done with the results of the endeavor. 

Construct Validity 

Construct validity is concerned with developing evidence that 
a test measures a certain variable defined by a theory. This form 
of validation is ordinarily studied when we have no definitive 
criterion of the attributes or qualities with which we are 
concerned, and must use indirect measures. The construct validity 
of an instrument cannot be directly assessed. Rather, one must 
employ different types of assessment procedures and data— e.g., 
analyses of group differences, item-analyses, inter-item and scale 
correlations, change over occasions, internal test structure, 
factor analyses, test taking process — that may be regarded as 
suitable evidence for both the existence of the construct, and the 
instrument's ability to measure it. 

The data employed to assess the construct validity of the IPS 
were collected as a part of a 1983 research study. The criteria 
for institutional selection included: status as a four-year 
institution, enrollment size (200 to 20,000 students) , 
institutional control (public versus private), the presence or 
absence of graduate programs and enrollment change. 334 
institutions and some 3200 respondents participated in the study. 

Item Analysis . An examination of the items' response rate 
was made to determine whether participants failed to respond to 
any particular items. A high non-response rate would indicate 
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that an item is not effectively worded (e.g., it is unclear, 
intimidating) or that it is not applicable to the respondent or 
the institution. Low response rate items should not be considered 
valid items and ought to be excluded from further analyses. 

Eighty-eight percent of the items had a 98% or better 
response rate and there appeared to be no pattern to the non- 
responses. The high response rate and variability of responses 
suggests that 1) respondents understood the questions, and 2) that 
the items can discriminate between institutions that actually 
differ on the dimensions being assessed — that is, essentially none 
of the items are ranked the same by all respondents. An item 
ranked the same by all respondents would provide no useful 
information . 

Factor Structure and Internal Consistency . Five of the eight 
sections (1, 2, 3, 4, and 6) of the IPS include questions that 
purport to measure unrelated dimensions or constructs. Two ways 
of assessing the extent to which this is true include examination 
of 1) the correlations between items in each section, and 2) the 
factors these correlations yield. Low correlations between items 
in the same section would be evidence that each item measures a 
relatively unique construct or dimension. Similarly, poorly 
defined factors (i.e., in terms of a "simple structure " 
criterion) would also be evidence that individual items are 
measuring relatively unique dimensions. The results of the 
analyses strongly suggest that the items contained in each of the 
sections measure relatively unique constructs or dimensions. 
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The questions in Sections 5, 7, and 8 measured i redefii ^d 
scales. The results of correlational analysis, facte analys' s, 
and internal consistency assessments suggest that the te^ ij 
Section 5 are reasonably good measures of their construe ,s. 
However, the results of our analysis suggests that several -har ges 
must be made in the questions thrt comprise Sections 7 and 6 

Our concerns regarding Section 7 (Resource Allocation) 
based on the poor correlations between paired items in two *:he 
six dimensions this section purports to measure: Bureaucratic 
Allocation, Political Allocation. 

The problems with Section 8 (Institutional Effectiveness) 
derive from the failure of the factor analyses to identify the 
nine dimensions the items in this ;ction purport to measure. 
More specifically, the results of our analysis do not support 
separate factor scores for Student Academic Development, 
Professional Development & Quality of the Faculty, and Ability to 
Acquire Resources. 

The studies comparing different groups' performance on the 
IPS lead to generally positive conclusions. Observed differences 
in the scores of public and private institutions generally reflect 
the kinds of differences one would expect to find as a function of 
differences in the mission, ro?e, and structure of these 
institutions. 
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Concur- ent Validity 

Concurrent validity is concerned with the relationship 
between fest scores and an accepted criterion of performance on 



-Vll- 



13 



the dimensions the test purports to assess. The reason for 
constructing a test for which one already has data is that the 
test saves time nnd expense, but gives the same results as the 
criterion measure. This form of validity is usually evaluated in 
terms of the correlation between the test and the criterion 
measure. 

Unfortunately, no criterion data are available with respect 
to the IPS that might be used to estimate a concurrent validity 
index. However, ethnographic data are available for eight 
institutions that used the IPS in an NCHEMS case study research 
project. 

A comparison of the results of the IPS with the ethnographic 
data for one of these institutions indicated a number of 
similarities and differences. The IPS data generally support 
what is reported in the ethnography. However, the IPS fails to 
capture or reflect the interrelationships between the dimensions 
assessed. This is not surprising in view of the modular nature 
of the instrument — that is, it is concerned with assessing single, 
relatively unique dimensions of performance. The instrument 
leaves the interpretation of scores and patterns of scores to the 
user. The IPS is certainly not alone in doing this. However, the 
comparison reveals that its modular nature may obscure or be 
insensitive to important institutional dynamics. 

Reliability 

Common synonyms for reliability include dependability, 
consistency, and stability. Reliability problems are concerned 
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with the accuracy with which a measuring instrument (e.g., a test) 
measures whatever it measures. Formally stated, the evaluation of 
reliability is the determination of how much of the variation in a 
set of test scores is due to certain systematic differences among 
the individuals in the group and how much to other sources of 
variation that are considered, for particular purposes, errors of 
measurement. There are numerous ways in which we can assess a 
test's reliability. These include test-retest, -'.nternal 
consistency, and rater reliability. 

Test-Retest Reliability 

No adequate data were available to assess the test-retest 
reliability of the IPS. 

Internal Consistency Reliability 

As previously noted, five of the eight sections of the IPS 

(Sections 1, 2, 3, 4, and 6) include questions that are intended 
to measure relatively unique dimensions. To estimate this form of 
reliability for these sections would be inappropriate. The 
questions in Sectio. s 5, 7, and 8, measured predefined scales. 
Discussions of the results of analyses pertinent to these sections 
are included in the section on construct validity. 

Rater Reliability 

Rater reliability is concerned with the degree of similarity 
or agreement between raters' evaluation of an object or set of 
objects. The report format of the IPS implicitly assumes that 
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m group members' scores may be meaningfully aggregated. The 

validity of this assumption may be assessed by estimating the 

■ intraclass correlation coefficient for each item of the 
instrument. 

| Estimated coefficients ranged between 0 and .60. However, 

mm more than 80% of the coefficients are less than .30. The 

generally low nature of these estimates suggest that it is 

■ inappropriate to believe that group means fairly reflect the 
perceptions of individual group members. In other words, 

| employing group means to draw conclusions about perceptions of 

_ institutional performance, or to make generalizations about 

■ conditions, may lead to spurious conclusions. This suggests that 

■ 1) the IPS report should include frequency data for each 
respondent group on each item; and, 2) the Executive Report should 

■ be rewritten to address this problem. 



Conclusion 

In general, the Institutional Performance Survey appears to 
do a reasonably good job of assessing most of the constructs or 
dimensions it purports to measure. Its most serious problems 
include the 1) use of ambiguous language; 2) weak assessment of 
two of the six scales in Section 7 (Bureaucratic Allocation, and 
Political Allocation), and probably three of the nine scales in 
Section 8 (Student Academic Development, Professional Development 
& Quality of the Faculty, and Ability to Acquire Resources); 3) 
lack of a "Don't Knew" response category in the questionnaire; and 
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4) lack of item-response frequencies in the Executive Report. It 
would seem that all of these problems can be easily remedied. 

In considering th'j overall utility of the instrument two 
factors appear to be critical. First, it seems that the best and 
most appropriate use of the IPS is to employ it as a means of 
beginning an institutional self-study. That is, the IPS appears 
to do a fairly good job of identifying many institutional 
strengths and weaknesses. However, failure to seriously 
investigate 1) what an institution's scores on the dimensions 
assessed actually mean; and 2) how conditions are related and 
impact one another — may lead to spurious or inappropriate 
conclusions . 

S'.cond, the most critical factor determining the utility of 
the IPS is the extent to which participants in the assessment 
process believe that their efforts will have an impact on 
institutional conditions. The utility of the instrument is not 
primarily a function of what it measures or fails to measure. 
Rather, its utility is primarily a function of the commitment and 
expectation of those involved that something positive will 
actually come from their efforts. 
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■ AN 

■ ASSESSMENT OF THE VALIDITY AND RELIABILITY OF THE 

INSTITUTIONAL PERFORMANCE SURVEY 

The Institutional Performai.ee Survey (IPS) is the by-product 
J of a national research study whose primary intent was to assess 

how various institutional conditions were related to an 

■ institution's external environment, strategic competence, and 

■ 3ffectiveness. After the IPS was used in the national study many 
institutions sought to purchase the instrument for self-study 

■ purposes. The intent of the current effort is to assess the 
validity and reliability of the IPS with respect to its use as 

| an institutional self-study instrument. 

m We begin by providing a brief overview of the instrument and 

the thinking behind its development. The remainder and lion's 

■ share of the assessment will focus on reporting and interpreting 
analyses performed to assess its psychometric properties. 

- The IPS 

The development of the IPS followed from the efforts of 
I NCHEMS Organizational Studies Division's attempts to address three 

questions ( NCHEMS-Organizational Studies FY 83-84 Technical 
| Proposal, IV: 21-25): 

_ 1) Can diagnostic instruments be developed that 

■ accurately assess instititutonal conditions 

■ relative to the external environment, strategic 

competence, and level of effectiveness? 

I -1- 
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2) What are the most powerful predictors of effective 
strategic adaptation to conditions of decline in 
higher education? 

3) What characteristics of top managers in higher 
education are associated with successful 
institutional adaptation? 

Research done by the Organizational Studies (OS) Division 
identified eight areas and concomitant variables in which 
questions would have to be developed in order to address the 
issues noted above. The areas included: external environment, 
enrollment conditions, revenue conditions, structural and process 
characteristics, culture, strategy, resource allocation, and 
effectiveness. Descriptions of the areas and variables, and the 
questions that are intended to operationalize them are contained 
in the administrative feedback report. Tl is report, formally 
referred to as the "Executive Report," summarizes the results of 
the IPS for a specific institution. A sample report, which 
includes a copy of the IPS, is included as Appendix 1. 

The pilot version of the instrument was administered at a 
local four-year institution. OS staff talked with respondents 
about their reactions to the questionnaire and their 
interpretation of specific questions. The results of this effort 
were used to modify the instrument. The modified version, which 
was called "An Assessment of the Performance of Colleges and 
Universities," was used to conduct the national research study in 
1983. A copy of this instrument is included as Appendix 2. 
Comparison of the IPS with the instrument used in the 1983 
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national study reveals minor differences in organization and 
format. The IPS also excludes a handful of questions that 
appeared to be redundant and/or ambiguous. 



Psychometric Assessment 

The purpose of this research is to assess the validity and 
reliability of the IPS. We shall begin with the validity issue. 
According to Magnusson, "the validity of a method is the accuracy 
with which meaningful and relevant measurement can be made with 
it, in the sense that it actually measures the traits it was 
intended to measure" (1967, p. 124). He argues that for every 
validation procedure the essential question is: for whom and for 
what purpose is the test to be valid. Several different types of 
validity are discussed in the psychometric literature. Here are 
brief characterizations of the ones that shall be addressed in 
this assessment. 

Pace validity, as noted by Ebel, "refers not to what a test 
necessarily measures, but to what it appears to measure" (1972, p. 
437). According to Mosier (1967), three meanings have been 
attributed to the term: 1) validity by definition—the items 
appear to the "subject-matter expert" to adequately represent the 
domain of interest; 2) validity by assumption—the items appear 
"on their face" to bear a common sense relationship to the 
objective of the test; and, 3) validity by appearance— the test 
should be perceived as pertinent and related to its intended 
purposes . 
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Content validity is concerned with the adequacy of sampling 
of the specified universe of content (Ebel, 1972). Before content 
validity can be assessed one must explicitly define the domain an 
instrument is intended to assess. Having done so, one must then 
determine the extent to which the sample of items in the test is 
representative of the total population (domain). 

Concurrent validity, according to Ebel, "is concerned with 
the relation of test scores to an accepted contemporary criterion 
of performance on the variable that the test is intended to 
measure" (1972, p. 436). The reason for constructing a test to 
measure a variable for which one already has data is, in most 
cases, that the test saves time and expense, but gives the same 
results as the criterion measure (Magnusson, 1967). 

Construct validity is concerned with the validation of tests 
that purport to measure hypothetical attributes or qualities. 
Construct validity is ordinarily studied when we have no 
definitive criterion measure of the qualities or attributes with 
which we are concerned, and must use indirect measures. 
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Content Validity 

As previously noted, content validity is concerned with the 
adequacy of sampling from the domain or domains an instrument 
purports to measure. In assessing the content validity of the IPS 
we are confronted by its dual roles— first as a research tool, and 
second as a diagnostic or assessment instrument for institutional 
managers. While these roles overlap, they are not equivalent. 
Thus, while the instrument may demonstrate strong validity when 
assessed on the first criterion, it may be seriously lacking when 
evaluated on the second. 

In considering the content validity of the IPS with respect 
to its use by institutional managers we must concern ourselves 
with what it is supposed to be used for — a self-study tool. 
According to the "Executive Report," the IPS "provides 
administrators with information about institutional 
characteristics, functioning, and performance." Remedial action 
is suggested when the data indicate negative perceptions of 
institutional performance on these dimensions, and/or when there 
are major differences of opinion about performance. 

Unfortunately, the research literature offers little 
guidance regarding the criteria that should be employed (that is, 
that are appropriate and essential) to judge the content validity 
of a college and university self -study instrument. However, at 
least two other possibilities for evaluating the content validity 
of the IPS seemed possible. The first entails comparing the 
dimensions and constructs assessed by the IPS with those assessed 
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by similar instruments— similar in the sense that they purport to 
measure the same things or serve the same purpose. 

The second involves capitalizing on work currently in 
progress at NCHEMS that is concerned with developing a compendium 
of measures to assess institutional effectiveness (Krakower, 
1985). The compendium utilizes a framework that is intended to 
include most of the criteria that are pertinent to institutional 
effectiveness. We can compare the dimensions included in the 
effectivenes framework with those assessed by the IPS. 

Unfortunately, both alternatives entail some problems. 
First, the terminology used to describe the constructs and 
dimensions to be compared is not universal. For example, a 
question or construct may be labeled "autonomy" in one study, and 
be referred to as "freedom" in another— even though the questions 
are identical. Conversely, questions or constructs may "e labled 
identically and be concerned with different issues. There is no 
simple solution to this problem. In the analyses that follow, 
comparisons will be based on the descriptions of factors and the 
questions that purport to measure them rather than on titles or 
labels. 

Second, the comparisons that follow simply indicate whether 
or not the IPS includes at least one or more questions on the 
domains of interest. True content validation is concerned with 
the adequacy of sampling within the domains of interest. 
Unfortunately, the resources allocated to this project, the lack 
of gospel in the literature, and the lack of clarity in the 
purpose of the IPS, obviate a true assessment. 
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In the analyses that follow the dimensions or constructs 
assessed by the IPS are compared with three published instruments: 
Institutional Functioning Inventory (Educational Testing Service, 
1970), Institutional Goals Inventory (Educational Testing Service, 
1977), and the Needs Assessment Survey (Higher Education 
Management Institute, 1981). In comparing the IPS with these 
instruments it is essential to keep in mind that each serves 
slightly different purposes. Hence, we should expect that those 
instruments may assess factors and constructs not assessed by the 
IPS. Conversely, it will be seen that the IPS assesses dimensions 
that are not assessed by any one or combination of these 
instruments. A list of the variables assessed by the IPS are 
reported in Table 1. 



Institutional Functioni n g Inventory and the IPS 

According to the technical manual of the Institutional 
Functioning Inventory (IFI), the IFI was developed primarily as a 
self-study instrument. It is described as providing a means by 
which a college or university can describe itself in terms of a 
number of characteristics judged to be of importance in American 
higher education. "The instrument assumes that different 
individuals and constituent groups will perceive the institution 
differently; the IFI affords the opportunity for study of sources 
of disparate beliefs about the work of the college."l 

x Richard E. Peterson, John A. Centra, Rodney T. Hartnett, 
Robert L. Linn. Institutional Functioning Inventory; Preliminary 
Technical Manual, Educational Testing Service, Princeton, Nev* 
Jersey, 1983, p. 1. 
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Table 1 
Variables Assessed by the 
Institutional Performance Survey 

1. CHANGES IN THE INSTITUTIONAL ENVIRONMENT 

1. Enrollment Predictability 

2. Revenue Predictability 

3. Competitor Predictability 

4. Students' Tastes and Preferences 

5. Intensity of Competition 

6. Enrollment Competition 

7. Supply of Students 

8 . Availability of Financial Resources 

2. INSTITUTIONAL ENROLLMENTS 

1. Consensus 

2. Inevitability 

3. Administrative Control 

4. Duration 

5. Threat 

3. INSTITUTIONAL REVENUES 

1. Consensus 

2. Inevitability 

3. Administrative Control 

4. Duration 

5. Threat 

4. INSTITUTIONAL FUNCTIONING 

1. Specialization 

2. Formalization 

3. Mission 

4. Investor Confidence 

5. Structural Coupling 

6. Centralization 

7. Planning 

8. Innovation 

9. Scapegoating 

10. Resistance to Change 

11. Administrative Turnover 

12. Morale 

13. Slack Resources 

14. Interest Groups 

15. Administrator Credibility 

16. Reallocation Priorities 

17. Conflict 

18. Locus of Control 

19. Internal Mobility 
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INSTITUTIONAL CULTURE 

1. Type 

2. Leader 

3. Cohesion 

4. Emphases 

INSTITUTIONAL STRATEGY 

1. Diversity 

2. Conservatism 

3. Moderate Change 

4. Innovation 

5 . Administration 

PJJ OURCE ALLOCATION 

-l. Bureaucratic Allocation 

2. Autocratic Allocation 

3. Collegial Allocation 

4. Rational Allocation 

5. Allocation as Organized Anarchy 

6. Political Allocation 

INSTITUTIONAL EFFECTIVENESS 

1. Student Educational Satisfaction 

2. Student Academic Development 

3. Student Career Development 

4. Student Personal Development 

5. Faculty and Administrator Employment Satisfaction 

6. Professional Development and Quality of the Faculty 

7. System Openness and Community Interaction 

8. Ability to Acquire Resources 

9. Organizational Health 
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The IFI contains 132 items which measure eleven dimensions or 
scales. Brief descriptions of these scales are provided in Table 
2. The manual points out thrt high scores on all the dimensions 
assessed by the instrument would not necessarily be good for all 
colleges. The critical factor in assessing respondents 
perceptions is 1) the mission and objectives of the institution; 
and 2) significant differences between administrator and faculty 
perceptions of the institution. 

The data in Table 3 shows the results of our comparison of 
the dimensions assessed by the IPS with those assessed by the IFI. 
The data in this table indicate that the IPS includes questions 
that touch upon eight of the eleven dimensions or areas assessed 
by the IFI. The threo areas in which no overlap seems to occur 
are: 1) Freedom, 2) Concern for Improvement of Society, and 3) 
Concern for Undergraduate Learning. We shall defer discussion of 
these differences in favor of a summary assessment based on all 
the comparisons that follow. 

Institutional Goals Inventory and the IPS 

The Institutional Goals Inventory (IGI) was "developed as a 
tool that a college may use in the process of idertifying basic 
campus goals and in determining priorities among diverse goals. 
Additionally, the IGI can indicate the degree of consensus among 
people at the college regarding the importance of each goal. "2 

2 Kicnard e. Peterson and Norman p. uhl. Fo rmulating College and 
university Goals: A Guide for Using the IGI . " Educational Terming 
Service, Princeton, New Jersey, 1977, p. 1. 
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Table 2 
Dimensions assessed by the 
Institutional Functioning Inventory 



Intellectual-Aesthetic Extracurriculum refers to the 
availability of activities and opportunities for 
intellectual e.nd aesthetic stimulation outside the 
classroom. 



ERLC 



>. Freedom has to do with academic freedom for faculty and 
students as well as freedom in their personal lives for 
all individuals in the campus community. 

3- Human Diversity nas to do with the degree to which the 
faculty and studen body are heterogeneous in their 
backgrounds and present attitudes. 

4. Concern for Improvement of Society refers to * desire 

among people at the institution to apply their knowledge 
and skills in solving social problems and prompting 
social change in America. 

5 - Concern for Undergraduate Learning describes the degree 
to which the college — in its structure, function, and 
professional commitment of faculty — emphasizes 
undergraduate teaching and learning. 

Democratic Governance reflects the extent to which 
individuals in the campus community who are directly 
affected by a decision have the opportunity to 
participate in making the decision. 

7 - Meeting Local Needs refers to an institutional emphasis 
on providing educational and cultural opportunities for 
all adults in the surroundina area, as well as meeting 
needs for trained manpower on the part of local 
businesses and government agencies. 

8 * Self-Study and Planning has to do with the importance 

college leaders attach to continuous long-range planning 
for the total institution, and to institutional research 
needed in formulating and revising plans. 

9. Concern for Advancing Knowledge reflects the degree to 
which the institution — in its structure, function, and 
professional commitment of faculty — empnasizes research 
and scholarship aimed at extending the scope of human 
knowledge . 

10. Concern for Innovation refers, in its highest form, to an 
institutionalized commitment to experimentation with new 
ideas for educational practice. 

11 • Institutional Esprit refers to a sense of shared purposes 
and high moral among faculty and administrators. 
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Table 3 

Comparison of the Institutional Performance Survey 

With the 

Institutional Functioning Inventory 
I nstitutional Functioning Inventory ips 



1. Intellectual-Aesthetic Extracur riculum Y 

2. Freedom N 

3. Human Diversity y 

4. Concern for Improvement of Society N 

5. Concern for Undergraduate Learning N 

6. Democratic Governance y 

7. Meeting Local Needs y 

8. Self-Study and Planning y 

9. Concern for Advancing Knowledge y 

10. Concern for Innovation Y 

11. Institutional Esprit Y 
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Included among the uses cited for IGI data are planning, 
evaluation, curriculum design, and organizational development. 

The IGI consists of 90 goal statements. Eighty are related 
to twenty goal areas, four per goal area. The remaining ten are 
miscellaneous— each reflecting a goal to be sufficiently important 
to be included, but as a single statement only. Brief 
descriptions of the goal areas are included in Table 4. 

The IGI differs most in format from the other instruments 
included in this comparison in that it asks each respondent to 
make two judgments on each question; 1) how important the goal 
"is"; and 2) how important the goal "should be." Suggested study 
participants include faculty, administrators, students, trustees, 
members of the community, and alumni. 

Table 5 reports the results of the comparison of the IPS with 
the IGI. The data in this table indicate that the IPS touches 
upon seventeen of the thirty goal areas assessed by the IGI. The 
IPS appears to assess slightly more than half of the goals 
considered by the developers of the IGI as critical to 
institutional planning, development, evaluation, and curriculum 
design . 
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Needs Assessment Survey and the IPS 

The Needs Assessment Survey (NAS) is just one component of a 
five phase management development program jointly developed by the 
American Council on Education and the Higher Education Management 
Intitute. Participation in the program generally entails a 36 to 
48 month commitment. The NAS is characterized as the means within 
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Table 4 
Dimensions Assessed by the 
Institutional Coals Inventory 



1. 



OUTCOME GOALS 



2. 



3. 



4. 



5. 



6. 



7. 



Academic Development has vo do with acquisition of 
general and specialized knowledge, preparation of 
students for advanced scholarly study, and maintenance 
of high intellectual standards on the campus. 

Intellectual Orientation relates to an attitude about 
learning and intellectual work. It means familiarity 
with research and problem solving methods, the ability 
to synthesize knowledge from many sources, the capacity 
for self-directed learning, and a commitment to lifelong 
learning. 

Individual Personal Development means identification by 
students of personal goals and development of means for 
achieving them, enhancement of sense of self -worth and 
self-confidence. 

Humanism/ Altruism reflects a respect for diverse 
cultures, commitment to working for world peace, 
consciousness of the important moral issues of the time, 
and concern about the welfare of man generally. 

Cultural/Aesthetic Awareness entails a heightened 
appreciation of a variety of art forms, required study 
in the humanities or arts, exposure to forms of non- 
Western art, and encouragement of active student 
participation in artistic activities. 

Traditional Religiousness is intended to mean a 
religiousness that is orthodox, doctrinal, usually 
sectarian, and often fundamental — in short, 
traditional rather than secular or modern. 

Vocational Preparation means offering specific 
occupational curriculums (as in accounting or nursing), 
programs geared to emerging career fields, opportunities 
for retraining or upgrading skills, and assistance to 
students in career planning. 

Advanced Training can be most readily understood simply 
as the availability of postgraduate education. It means 
developing and maintaining a strong and comprehensive 
graduate school, providing programs in the professions, 
and conducting advanced study in specialized problem 
areas . 
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Research involves doing contract studies for external 
agencies, conducting basic research in the natural and 
social sciences, and seeking generally to extend the 
frontiers of knowledge through scientific research. 

Meeting Local Needs is defined as providing for 
continuing education for adults, serving as a cultural 
center for the community, providing trained manpower for 
local employers, and facilitating student involvement in 
community-service activities. 

Public Service means working with governmental agencies 
in social and environmental policy formation, committing 
institutional resources to the solution of major social 
and environmental problems, training people from 
disadvantaged communities, and generally beinq 
responsive to regional and national priorities in 
planning educational programs. 

Social Eqalitarianism has to do with open admissions and 
suitable education for all admitted, nroviding 
educational experiences relevant to the evolving 
interests of minority groups and women, and offering 
remedial work in basic skills. 

Social Criticism/Activism means providing criticisms of 
prevailing American values, offering ideas for changing 
social institutions judged to be defective, helping 
students learn how to bring about change in American 
society, and being engaged, as an institution, in 
working for basic changes in American society, 

2. PROCESS GOALS 

1. Freedom is defined as protecting the right of faculty to 
present controversial ideas in the classroom, not 
preventing students from hearing controversial points of 
view, placing no restrictions on off-campus political 
activities by faculty or students, and ensuring faculty 
and students the freedom to choose their own life- 
styles. 

2* Democratic Governance means decentralized decision- 
making arrangements by which students, faculty, 
administrators, and governing board members can all be 
significantly involved in campus governance; opportunity 
for individuals to participate in all decisions 
affecting them; and governance that is genuinely 
responsive to the concerns of everyone at the 
institution. 



10. 



11. 



12. 



13. 
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Community is defined as maintaining a climate in which 
there is faculty commitment to the general welfare of 
the institution, open and candid communication, open and 
amicable airing of differences, and mutual trust and 
respect among students, faculty, and administrators. 

Intellectual /Aesthetic Environment means a rich program 
of cultural events, a campus climate that facilitates 
student free-time involvement in intellectual and 
cultural activities, an environment in which students 
and faculty can easily interact informally, and a 
reputation as an intellectually exciting campus. 

Innovation is defined as a climate in which continuous 
innovation is an accepted way of life; it means 
established procedures for readily initiating curricular 
or instructional innovations; and, more specifically, it 
means experimentation with new approaches to 
individualized instruction and to evaluating and grading 
student performance. 

Off-Campus Learning includes time away from the campus 
in travel, work-study, VISTA work, etc.; study on 
several campuses during undergraduate programs; awarding 
degrees for supervised study off the campus; awarding 
degrees entirely on the basis of performance on an 
examination . 

Accountability /Efficiency is defined to include use of 
cost criteria in deciding among program alternatives, 
concern for program efficiency, accountability to 
funding sources for program effectiveness, and regular 
submission of evidence that the institution is achieving 
stated goals • 
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Table 5 

Comparison of the Institutional Performance Survey 

With Lh- 
Institutional Goals Inventory 

Institutional Goals Inventory IPS 

I. Outcome Goals 

1. Academic Development Y 

2. Intellectual Orientation Y 

3. Individual Personal Development Y 

4. Humanism/Altruism N 

5. Cultural/Aesthetic Awareness Y 

6. Traditional Religiousness N 

7. Vocational Preparation Y 

8. Advanced Training N 

9. Research Y 

10. Meeting Local Needs Y 

11. Public Service Y 

12. Social Egalitarianism N 

13. Social Criticism/Activism N 



N 



II. Process Goals 

1. Freedom 

2. Democratic Governance Y 

3. Community Y 

4. Intellectual/Aesthetic Environment Y 

5. Innovation Y 

6. Off-Campus Learning N 

7. Accountability/Efficiency N 



III. Miscellaneous Goals 

1. Reading, writing, math competency N 

2. Institutional autonomy N 

3. Reputation Y 

4. Student extracurricular activities Y 

5. Planning Y 

6. Include citizens in planning , N 

7. Intercollegiate athletics N 

8. Systematic evaluation of programs N 

9. Educate outsiders about institution Y 
10. Consensus about goals Y 
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the program cf obtaining a quantitative description of an 
institution's "current management functioning." NAS topic areas 
and survey categories are shown in Table 6. 

The NAS actually consists of eight different questionnaires. 
One for 1) staff, 2) governing board members, 3) faculty, 4) 
students, 5) president/chancellor, 6) committee members, 
7) vice presidents/deans/directors, and 8) department/division 
heads. The questionnaires share some areas of overlap, but each 
has its own distinct set of questions that follow from the unique 
roles, responsibilities, and relationships that are associated 
with being a member of one of these groups. 

The comparisons between the IPS and the NAS are based on the 
"factors" measured by the entire set of NAS questionnaires. These 
are briefly described in Table 7. The comparisons were made 
against the factors, as opposed to the topic areas and survey 
categories shown in Table 6, for two reasons. 1 First, the 
factors were developed using a statistical technique (factor 
analysis) which identifies discrete dimensions of the instrument. 
Many of the questions included in the NAS, however, are used to 
measure more than one survey category. Second, the comparisons 
made between the IPS and both the IFI and IGI are based on 
"factors" derived from these instruments. Using the factors of 
the NAS allows us to be consistent witn the comparisons made with 
the other instruments. 




x The factors are described in detail in Chase Monograph 3;~An~ 
Analysis of the ACE/ HEMI Data Base . Higher Education Management 
Institute. 2699 Bayshore Drive, Coconut Grove, Florida, 33133. 



-18- 



35 



Table 6. 
Needs Assessment Survey 
Topic Areas and Survey Categories 



(^} HEMI Program Structure 



MANAGEMENT 
CATEGORIES 


TOPIC AREAS 


SURVEY CATEGORIES 


TITLES OF MODULES 
AND DEVELOPMENT MANUALS 




1.1 Managing 


1.10 Managing, Manager 


1.1.1 Management Concepts 






1.11 Managing, Standards 


1.1.2 Managing Change 






1.12 Managing, Institution 


1.1.3 Institutional Renewal 



1.2 Leading 




1.20 Leading, 

1.21 Leading, 

1.22 Leading, 

1.23 Leading, 

1.24 Leading, 

1.25 Leading, 

1.26 Leading, 



Influence- Have Now 
Influence-Should Have 
Participation 
Competence* Leader 
Competence-Dean 
Competence-President 
Competence • Board 



Tasks 



1.3 Motivating 

1.4 Communicating 

1.5 Team Building 

1 .6 Decision Making 



1.30 Motivating, Manager 

1.31 Motivating, Institution 



1 .40 Communicating, Manager 

1.41 Communicating, Peers 

1.42 Communicating, Institution 

1,50 Team Building 



1.60 Decision Making, Manager 

1.61 Decision Making, Institution 



1.2.1 Leading 1 
1.2.1 Leading 2 

1.2.3 Leadership and Human Relations 



1.3.1 Motivating 1 

1.3.2 Motivating 2 

1.3.3 Organizational Climate 

1.3.4 Management Conflict 

1.4.1 The Communication Process 

1.4.2 Communication Feedback 

1.4.3 Organizational Communication 

1.5.1 Team Building 1 

1.5.2 Team Building 2 

1.6.1 Principles of Decision Making 

1.5.2 Problem Solving 



2.1 Planning 
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Processes 



2.2 Budgeting 

2.3 Organizing 

2.4 Marketing 

2.5 Evaluating 



2.10 Planning, Manager 

2.11 Planning, Institution 

2.20 Budgeting 

2.30 Organizing. Work Activities 

2.31 Organizing, Staffing 



2.40 Marketing, External 

2.41 Marketing, Prospective Students 

2.50 Evaluating, Manager 

2.51 Evaluating, Institution 



2.1.1 Institutional Planning 

2.1.2 Defining Goals and Objectives 

2.2.1 Budget Preparation and Control 

2.3.1 Role and Responsibility 

2.3.2 Legal Rights and Obligations 

2.3.3 Recruitment and Selection 

2.4.1 Preparing and Using a Marketing Plan 



2.5.1 Individual Development Planning 

2.5.2 Productivity 

2.5, r dividual Progress Review 

2.5.4 institutional and Program Evaluation^ ^ 




Activities 



i 

to 
o 
I 



3.1 Instruction 

3.2 Research 

3.3 Public Service 

3.4 Academic Support 

3.5 Student Services 



3.10 Instruction. Department/Division 

3.11 Instruction, Institution 

3.12 Instruction, Change 

3.20 Research 
3.30 Public Service 
3.40 Academic Support 

3.50 Student Services 



3.6 Institutional Support 



3.7 Independent Operations 



3.60 Institutional Support Services 



3.70 Independent Operations 



3.1.1 Instruction 

3.2.1 Research 
3.3.1 Public Service 

3.4.1 Libraries 

3.4.2 Media Services 

3.5.1 Admission and Recruitment 

3.5.2 Registration and Records 

3.5.3 Financial Aid 

3.5.4 Counseling and Career Guidance 

3.5.5 Health Services 

3.5.6 Student Activities 

3.6.1 Personnel and Payroll 

3.6.2 Purchasing and Accounting 

3.6.3 Administrative Data Processing 

3.6.4 Public Relations/Development 

3.6.5 Physical Plant 

3.7.1 Bookstore 

3.7.2 Food Services 





4.1 Managing Time 


4.10 Management Effectiveness 
Managing Time 


4.1 .1 Time Management for Managers 
and Work Groups 




4.2 Conducting Meetings 


Conducting Meetings 


4 2.1 Better Meetings 
4.2.2 Presenting Modules 


I 4.3 Analyzing Information 


Analyzing Information 


4.3.1 Management Information Systems 








4.4 Negotiating 


Negotiating 


4.4.1 Labor Relations 



Skills 



4.5 Career Planning 



Career Planning 



4.5.1 Career Renewal 

4.5.2 Managing Stress 
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5. Outcome Measures 



5.10 Educational Objectives -Are 

5.11 Educational Objectives - Should Be 

5.12 Perceived Reputation 

5.13 Job Satisfaction 



6. Demographic 
Characteristics 

• Sex 

• Enrollment Status 

• :iass Year 

• Employment Status 

• Years in Current Position 
•Tenure Status 



7. Central Administration- 
Campus Relations 

7.10 Managing 

7.20 Leading. Participation 

7.30 Leading, Influence 

Have and Should Have 
7.40 Communication 
7.50 Team ?uilding 
7.60 Planning and Budgeting 
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Table 7 



Dimensions Assessed by the 
Needs Assessment Survey 

INTERPERSONAL RELATIONS 

!• Peer Relations ; Open communication with peers, 
sufficient interaction, friendly and supportive 
relations . 

2 « Leader/Member Relations ; Open communication with group 
leader, sufficient interaction, friendly and supportive 
relations . 

3. Relations With the President ; High regard for president 
as manager and educational leader, sufficient 
interaction, friendly and supportive relations. 

4 « Faculty/Dean Relations ; High regard for dean as manager 
and educational leader, sufficient interaction, friendly 
and supportive relations. 

5. Administrator/Faculty Relations ; High regard for 
faculty, sufficient interaction. 

6- Administration/Department Head Relations ; Good 
communication, confidence and trust, mutual 
understanding . 

7 « Faculty/Student Relations ; Friendly and supportive 
relations, good exchange of ideas, students show 
excitement about learning. 

8 * Student/Faculty Relations ; High regard for competence of 
instructional faculty, good communication with faculty, 
sufficient interaction. 

LEADING 

!• Participative Management ; Willingness of leader to seek 
options, suggestions, and ideas to involve others in 
decision making, and to delegate authority and back 
people up. 

2 « Objectives and Standards ; Leader involves group members 
in developing standard of performance, maintains 
standards , and evaluates performance . 

3. Management ski lis : Effectiveness of leader in managing 
time, conducting meetings, analyzing information , 
negotiating, and career planning. 

OBJECTIVES AND PERFORMANCE REVIEW 

1. Objectives : Clarity of academic and general departmental 
goals and clarity of curriculum objectives. 
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Performance Feedback ; Satisfaction and frequence of 
quality of performance feedback. 



4 . INFLUENCE 



1. Perceived Upward Influence ; Perceived influence on 

educational activities by faculty, department heads, and 
students. 



2. 



Preferred Upward Influence ; Preferred influence on 
educational activities by faculty, department heads, and 
students. 



3 * Perceived Downward Influence ; Perceived influence on 
educational activities by the board, top staff, and 
deans. 

4. Pref erred Downward Influence ; Preferred influence on 
educational activities by the board, top staff, and 
deans . 

5. ORGANIZATIONAL CLIMATE 

1. Institutional Decision Making ; Objectives and fairness 
of budgetary decision making. 

2 * Institutional Communication ; Quality of upward and 
downward communications in the institution. 

3 * Institutional Standards ; Administration's concern for 
efficient use of resources and educational excellence. 

4 * Familiar ity with Institutional Governance ; Respondents' 
understanding of the vay decisions are made at the 
institution. 

5 * Preferred Teaching Orientation ; Respondents' preferred 
emphasis on six growth areas. 

6 ' Perceived Teaching Orientation ; Students' perception of 
extent this institution is contributing to six growth 
?reas. ' 

6. INSTITUTIONAL ENVIRONMENT 

1 « Responsiveness to Environment ; Awareness of community 
needs, responsiveness to community needs, offering of 
nontraditional programs, and use of innovative 
instructional techniques. 

2. Relations with External Agenc ies; Ef f ectivenes's of 

institutional relations with funding agencies, alumni, 
and local community. 



r o 
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OUTCOME MEASURES 



!• Jo b/Career Satisfaction : Satisfaction with position, 
salary, benefits, opportunities for growth and career 
advancement, and research at the institution, 

2 » Institutional Reputation : Rating of overall reputation 
of the institution by respondents and by the community, 
professional colleagues, and prospective employees, as 
perceivpd by respondents* 

3 * Satisfaction with Research : Satisfaction with research 
facilities and quality of research at the institution, 

4 • Satisfaction with Academic Department Procedures : 
Faculty satisfaction with academic department 
procedures. 

5- Satisfaction with F'Jucation-Related Services : 

Satisfaction with library, audiovisual services, research 
facilities, and bookstore. 

6 » Satisfaction with Student Services : Satisfaction with 

admissions, orientation, registration, course scheduling, 
and grade reporting. 

' = Satisfaction with Ancil lary Services : Satisfaction with 
food services, sports facilities, and recreational 
facilities. 

8 - Satisfaction with Personnel Policies/Procedures : 

Faculty/student satisfaction with the selection and 
promotion policies and procedures for faculty. 

9. Satisfaction with Administrative Support Services : 
Satisfaction with accounting, payroll, personnel 
services, and administrative data processing services. 

CAMPUS -CENTRAL ADMINISTRATION 

!• Participation : Central administration's perceived 

willingness to seek and use input from the campuses and 
involve campuses in planning and budgeting. 

2. Goal Clarity : Clarity of central administration's goals, 
objectives, policies, and procedures. 

3. Communication : Adequacy of information flow from central 
admini j *;ration to campuses. 

4 - Campus Relations : Sufti^ient interaction, friendly and 
supportive relations, encouragement of teamwork. 
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5. Influence ; Perceived and preferred influence of central 
administration on educational activities. 



^ -24- 

tRiC 43 



Table 8 reports the results of the comparison between the NAS 
and the IPS. The data in this table indicate that the IPS touches 
on only fourteen of the thirty-nine factors assessed by the NAS. 
This occurs for two reasons. First, several of the factors 
assessed by the NAS are concerned with relations between specific 
groups of people, and at specific levels of the organization. The 
IPS is concerned with "overall" institutional conditions. Second, 
several of the factors assessed by the NAS are concerned with 
"outcome measures" related to satisfaction with specific 
institutional services— e.g. , student services, administrative 
support services, ancillary services, etc. These are not assessed 
by the IPS. 



Effectiveness Framework and the IPS 

The Effectiveness Framework (EF), briefly described in Table 
9, follows from efforts to develop a compendium of measures and 
indicators that can be used to assess organizational 
effectiveness. The framework is described by Krakower (1985) as 
including most of the criteria found in the literature on 
organizational effectiveness. 

The EF is based on the assumption that most of the criteria 
that are discussed with respect tc organizational effectiveness 
primarily fall into one or four domains—goal achievement, 
internal processes, organizational climate, and environmental 
adaptation. No assumption is made about any one domain being more 
important than another. However, the model on which the framework 
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Table 8 



Comparison of the Institutional Performance Survey 

With the 
Needs Assessment Survey 



Needs Assessment Survey IPS 

1. Interpersonal Relations 

1. Peer Relations y 

2. Leader /Member Relations N 

3. Relations with the President N 

4. Faculty /Dean Relations N 

5. Administrator/Faculty Relations N 

6. Administration/Department Head Relations N 

7. Faculty/Student Relations y 

8. Student/Faculty Relations N 

2. Leading 

1. Participative Management y 

2. Objectives and Standards N 

3. Management Skills N 

3. Objectives and Performance Review 

1. Objectives N 

2. Performance Feedback N 

4. Influence 

1. Perceived Upward Influence N 

2. Preferred Upward Influence N 

3. Perceived Downward Influence N 

4. Preferred Downward Influence N 

5. Organizational Climate 

1. Institutional Decisionmaking y 

2. Institutional Communication y 

3. Institutional Standards y 

4. Familiarity with Institutional Governance y 

5. Preferred Teaching Orientation N 

6. Perceived Teaching Orientation N 

6. Institutional Environment 

1. Responsiveness to Environment Y 

2. Relations with External Agencies y 

7. Outcome Measures 

1. Job/Career Satisfaction y 

2. Institutional Reputation y 

3. Satisfaction with Research N 

4. Satisfaction with Academic Dept Procedures N 

5. Satisfaction with Education-re? ated Services N 

6. Satisfaction with Student Services N 

7. Satisfaction with Ancillary Services N 

8. Satisfaction with Personnel Policies N 

9. Satisfaction with Admin. Support Services N 
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8, Campus-Central Administration 



1. Participation y 

2. Goal Clarity y 

3. Communication y 

4. Campus Relations N 

5. Influence N 
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Table 9 
Effectiveness Framework 



Goal Achievement 

1. Outcomes 

a. knowledge, technology, and art forms 

b. human characteristics 

c. economic 

d. resource and service provision 

e. other maintenance and change 

i. aesthetic-cultural conditions 

ii . organizational format , activity , operations 

2. Profit — typically thought of as the amount of 
revenue from sales left after all costs and 
obligations are met. 

Internal Processes; This domain generally includes the 
(1) skills the organization's managers, commanding 
officers, or group leaders require for a) performing tasks 
centered on work to be done, and for b) interacting with 
other organizational members (Campbell, 110); and (2) the 
formal mechanisms required for an organization to function 
effectively. 

1. planning & goal setting — the degree to which the 
organization systematically plans its future steps. 

2. staffing — recognition of the organization's 
"personnel" needs, obtaining people to meet these 
needs, and placing people so that individual and 
organizational needs are in harmony. 

3. controlling — activity that checks actual progress 
against planned progress and suggests ways of 
modifying activities falling below expected levels of 
performance. 

4. organizing — recognition of the organization's 
needs, deploying resources to meet these needs. 

5. interpersonal relations — motivation of people to 
reach goals without deterioration of morale to both 
themselves and the organization; consideration? 
employee centeredness. 
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6. 



budgeting 



7. scheduling 

8. property management 

9. procurement 

10. evaluation — goal achievement, subsystem function, 
per sonne 1 , environment • 

11. Information Management and Communication-the 
collection, analysis, and distribution of information 
critical to organizational effectiveness. 

III. Organizational Climate 

1 . Autonomy 

a) autonomy — degree to which the group is 
independent of other groups; self-determination 
of group activity 

b) control — degree of group regulation of member 
behavior 

c) flexibility — extent to which group activities 
are free from constraint by custom, tradition, 
written rules, or unwritten codes 

d) responsibility — employee discretion in work, 
without supervisor checking up 

e) task structure — the degree to which the 
methods used to accomplish tasks are spelled out 
by the organization 

2. Structure 

a) orderliness 

b) routine 

c) formalization 

d) production emphasis — close, directive 
supervision 

e) stratification — differentiation of internal 
status hierarchy 

f) structure — emphasis on constraints, rules, 
regulations and formal procedures 

g) recognition and feedback — degree to which an 
individual knows what his supervisor and 
management think of his work and the degree to 
jwhich they support him 

h) standardization 

3. Consideration and Support 

a) personal dignity 

b) personal relations 

c) esprit — morale; social and achievement need 
satisfaction 
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d) intimacy — friendly social relations among 
members ; closeness of acquaintanceship; 
familiarity with personal details of each 
other's lives 

e) aloofness ~ high emotional distance from leader 

f) permeability — openness of group to new members 

g) human resources primacy — concern for welfare 
and happiness of workers 

h) warmth — friendliness within the work group and 
organization 

i) support — perceived helpfulness and backing 
received from superiors, peers, and subordinates 

j) potency — centrality of group membership in the 

lives of members 
k) status and moral — the general feeling among 

individuals that the organization is a good 

place in which to work 

Synergy 

a) cooperation vs. conflict 

b) cohesiveness 

c) hindrance — performance hindered by petty 
administrative details 

d) participation — proportion of time spent in 
group activities 

e) viscidity — cohesiveness; absence of dissension 
and conflict; degree to which all members 
function as a unit 

f) goal consensus — degree to which group goal is 
unitary, and explicit to all members 

g) standards — perceived importance of 
organizational goals and performance standards 

h) conflict — emphasis on working through rather 
than avoiding conflicts 

i) identity — feeling of belonging to the 
organization and work group 

j) achievement emphasis — the desire on the part 
of the organization to do a good job and 
contribute to the performance. 

Reward Orientation 

a) motivational conditions 

b) reward-performance relationship 

c) general satisfaction 

d) hedonic tone — amount of pleasure afforded by 
membership 

e) motivational conditions — presence and nature 
of organizational factors eliciting effort 

f) reward — level and perceived fairness of 
positive job outcomes 

g) reward/performance relationship — reflects the 
degree to which the granting of additional 
rewards such as promotions and salary increases 
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are based on performance and merit rather than 
other considerations such as seniority, 
favoritism, etc. 

Openness vs. Def ensiveness 

a) communications flow — freedom of flow of tas!; 
relevant information within and between groups 

b) openness vs. def ensiveness — degree to which 
people try to cover their mistakes and look good 
rather than communicate freely and cooperate 

c) security vs. risk — reflects the degree to 
which pressures in the organization ltad to 
feelings of insecurity and risk 

d) support for creativity, experimentation 

Participation vs. Decision Centralization 

a) disengagement — group merely going through the 
motions? low involvement 

b) decision making practices — decision making 
characterized by delegation and participation 
vs. centralization 

c) lower level influence ~ amount of influence 
possessed by workers and first level supervisors 

d) decision centralization — the extent to which 
decision making is reserved for top management 



Educational Climate: The measures most frequently 
used for studying educational environments are 
Stern's College Characteristics Index, Pace's 
College and Univeristy Environment Scales, Aston and 
Holland's Environmental Assessment Technique. 
Examples of dimensions assessed by these instruments 
follow. They are generally concerned with assessing 
the climate for students as evaluated by students. 
Similar dimensions can, however, be evaluated by non- 
students (e.g., faculty, administration). 

a) aspiration level — expectation that students 
will set high goals 

b) intellectual climate — devotion to scholarship 
in humanities, arts, and social sciences 

c) student dignity degree of student autonomy 
and self-determination 

d) academic climate — emphasis on academic 
excellence in humanities and physical sciences 

e) academic achievement — press for high student 
achievement 

f) self-expression — opportunity to develop 
leadership ability and self-assurance 
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g) group life — incidence of mutually supportive 
group activities 

h) academic organization — emphasis on 
organization and structure in the environment 

i) social form — press for "proper" social 
behavior 

j) party climate — party atmosphere 

k) vocational climate — press for practical and 

conservative activities 
1) scholarship — perceived environmental press for 

academic achievement; selectivity of the 

institution; importance of getting acceptable 

grades 

m) awareness — perceived press for self- 
expression; artistic orientation; intellectual 
press 

n) community — perceived press for social 

activities; affiliation with faculty and other 
students 

0) propriety — press for social conformity; 
constraint; deference to tradition 

p) practicality — emphasis on vocationalism; 
applied orientation 

Environmental Adaptation: The criteria which describe 
this dimension generally fall into two categories. One 
set reflects on an organization's "ability to adapt" to 
changing conditions; the other on how well it has done so, 

1. Productivity — is usually defined as the quantity of 
volume of the major product of service that the 
organization provides and is measured by 
organizational records of some sort. 

2. Efficiency 

a) Production 

i) technical 

ii) price 

iii) preference 

b) Exchange 

Efficiency is generally thought of in terms of a 
ratio that reflects some aspect of unit performance 
to the costs incurred for that performance. 
Economists, however, talk about at least three 
different aspects or interpretations of efficiency: 

1) technical efficiency, which refers to how 
resources are used in the production process; 2) 
price (or allocative) efficiency refers to how 
resources are allocated given their prices; and 3) 
preference (or value) efficiency, which refers to the 
relationship between the amount of resources used and 
the mix of outputs. These three aspects of 
efficiency taken together can be referred to as 
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production efficiency. This is to be distinguished 
from exchange efficiency, which refers to the 
delivery of products and services to customers* 

3. bargaining position ~ ability of the organization to 
exploit its environment in the acquisition of scarce 
and valued resources, 

4. capacity to test reality — ability to search out, 
accurately perceive, and interpret the real 
properties of the environment, 

5. f lexibility/adaptabiltiy — ability of the 
organization to change in response to environmental 
changes* 

6. growth — growth can be defined as an increase in 
such things as manpower, plant facilities, sales, 
profits, assets, and market share. It implies a 
comparison of the organization's present state with 
its past state. 

7. stability — maintenance of structure, function, and 
resources through time, and periods of stress 

8. client satisfaction 

9. control over environment 

10. security from external threats 

11. responsiveness to environmental conditions 

12. technology — including curriculum and instruction 

13. support services 

14 • resources (acquisition, adequacy, number, quality, 
type) 

15. readiness — the usual definition of this variable is 
in terms an overall judgment concerning the 
probability that the organization could successfully 
perform some specified task if asked to do so. 
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is based assumes that an organization is unlikely to be effective 
if it is not functioning well in all four domains. 

The results of the comparison between the IPS and EF are 
reported in Table 10. The data indicate that the IPS is "weakest" 
in its assessment of educational outcomes and the educational 
climate. This is not surprising in view of the fact that in order 
to assess these dimensions one must generally gather student-level 
data . 

Summary 

Review of the previous set of tables indicates numerous areas 
in which the IPS overlaps similar institutional self-study 
instruments. The IPS also appears to assess several areas not 
addressed by the IFI, IGI, or NAS. These areas include 
perceptions of 1) competition, 2) enrollment and revenue 
conditions, 3) resource allocation, and 4) institutional 
functioning— specifically, investor confidence, reallocation 
priorities, and slack resources. 

On the other hand, the data in the preceding tables indicate 
several areas that are not assessed by the IPS, but that may be 
important to institutional self-study. At the most general level, 
these areas or topics fall into six categories: 

(1) The assessment of educational outcomes. This type of 
assessment generally entails some form of student 
evaluation . 
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Table 10 

Comparison of the Institutional Performance Survey 

With the 
Effectiveness Framework 

Effectiveness Framework IpS 

I. Goal Achievement 

1 . Outcomes* 

a. Knowledge, Technology, and Art Forms 

b. Human characteristics y 

c. Economic 

d. Resource and Service Provision 

e. Other Maintenance and Change 

i. Aesthetic-Cultural Activities y 

ii. Organizational Format, Actvity, Operation Y 

2. Profit 



II. Interna] Processes 

1. Planning & Goal Setting y 

2. Staffing 

3. Controlling 

4. Organizing y 

5. Interpersonal Relations y 

6. Budgeting y 

7. Scheduling 

8. Property Management 

9. Procurement 

10. Evaluation y 

11. Information Management & Communication y 

III. Organizational Climate 

1 . Autonomy 

2. Structure y 

3. Consideration & Support y 

4. Synergy Y 

5. Reward Orientation y 

6. Openness vs. Def ensiveness 

7. Participation vs. Decision Centralization y 

8. Educational Climate 2 



N 

N 
N 



N 



N 
N 



N 
N 

N 



N 



N 



The IPS has at least one or two questions pertaining to each of 
the major categories under the Outcomes classification. However, 
as indicated in< Appendix X, the outcomes domain has more than 80 
subcategories. The IPS pays very little attention to student- 
related outcomes . 

Educational Climate criteria are concerned with the climate for 
students. Whereas, the previous criteria are essentially assessed 
relative to faculty and staff. The IPS is not administered to 
students. Respondents are, however, asked for their perceptions 
on a few of the items from the sample shown here. 
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a. Aspiration Level Y 

b. Intellectual Climate N 

c. Student Dignity N 

d. Academic Climate Y 

e. Academic Achievement N 

f. Self Expression N 

g. Group Life N 

h. Academic Organization N 

i. Social Form N 
j. Party Climate N 
k. Vocational Climate N 
1. Scholarship Y 

m. Awareness Y 

n. Community Y 

o. Propriety N 

p. Practicality N 

IV. Environmental Adaptation 

1. Produc x iv5 .y Y 

2. Efficiency N 

3. Bargaining Position Y 

4. CapacLty To Test Reality N 

5. Flexibility/Adaptability Y 

6 . Growth Y 

7. Stability Y 

8. Client Satisfaction Y 

9. Control Over Environment Y 

10* Security From External Threats N 

11. Responsiveness to environmental conditions Y 

12. Technology Y 

13. Support Services N 

14. Resources 

a. Acquisition Y 

b. Adequacy N 

c. Quality y 

d. Number N 

15. Readiness ^ 
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The assessment of educational climate. Again, this type 
of assessment generally entails some form of student 
evaluation. 

The assessment of relations between members of different 
groups — for example, between faculty and their 
department chair; or, between department chairs/deans 
and the president. 

The assessment of both current and desired conditions. 
The assessment of institutional public service and 
research goals. 

The assessment of productivity and efficiency. 
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Pace Validity 

As previously noted, the face validity of a test is not 
concerned with what a test necessarily measures, but what it 
appears to measure. Face validity is essential because without 
it, a test is unlikely to be purchased, employed, or given serious 
consideration by respondents. Mosier (1967) describes three 
meanings that have been attributed to the term: 1) validity by 
definition, 2) validity by assumption, and 3) validity by 
appearance. 

A test is considered to be valid by definition "if the sample 
of items appear to the subject-matter expert to represent 
adequately the total universe of appropriate questions" (Mosier, 
1967, p. 208). As such, it is very similar to content validity. 
However, by definition this form of validity generally requires 
evaluations by outside subject-matter experts (that is, experts 
other than the test-developer). 

Validity by assumption means "that a test is assumed to be 
valid for the prediction of an external criterion if the items 
which compose it 'appear on their face' to bear a rommon-sense 
relationship to the objective of the test" (Mosier, 1967, p. 208). 
This form of validity generally entails no statistical 
assessment . 

The "appearance of validity" criterion entails the notion 
that a test must not only have pragmatic or statistical validity, 
but that it should "appear practical, pertinent, and related to 
the purpose of the test as well" (Mosier, 1967, p. 208). Mosier 
argues that without this form of validity, a test is neither 
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likely to be selected for use, nor find acceptance for its 
results. In other words, he argues, the nature of a test must be 
such that it has a "high degree of consumer acceptance." 

Validity By Definition 

The IPS appears to fall short on this criterion— it was not 
reviewed by anyone outside of NCHEMS. On the other hand, as 
previously noted in the discussion of the instrument's content 
valicm__. , the appropriate domain of institutional self-study is 
neither empirically defined, nor agreed upon. This makes it quite 
difficult to find subject-matter experts to review the 
instrument . 



Validity By Assumption 

This form of validity requires that the items of the 
instrument bear a "common-sense" relationship to the objective of 
the test. We have assumed that the objective of the IPS is to 
facilitate institutional self-study. This suggests that if: 

(1) the constructs or dimensions measured by the IPS "appear 
on their face" to be necessary a.id sufficient to perform 
an institutional self-study; and, 

(2) the items of the IPS "appear on their face" to 

(a) measure their respective constructs; and 

(b) adequately sample their respective construct 
domai ns — 
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then, the test meets the validity by assumption criterion. 

As previously noted, lack of knowledge obviates evaluating 
whether the constructs measured by the IPS are necessary and 
sufficient to perform an institutional self-study (item 1 above). 
And, lack of knowledge and resources also obviate evaluating 
whether specific constructs are being adequately sampled (item 2b 
above). However, data are available that reflect on the extent to 
which items measure their respective constructs (item 2a above). 
The utility of this data rests on the assumption that an item 
measures its respective construct if respondents are interpreting 
it as intended. 

The data were collected as part of a case study project 
currently in progress at NCHEMS. Some 50 faculty and 
administrators at five institutions were questioned regarding 
their responses to specific items on the questionnaire. The 
objective and focus of the interviews was to determine the extent 
to which responses were based on conditions and events that were 
intended to influence ratings. Respondents' comments regarding 
ambiguities or difficulties with questions were viewed as 
negatively reflecting on the "validity by assumption" criterion. 

Samples of respondents' comments to questions in Sections 1, 
4, 6, 7, and 8, are included in Appendix 3. The respondents' 
comments generally suggest that most of the questions were 
interpreted as intended. However, several problems appear to 
attend both the language and construction of the instrument. Most 
of these are sufficiently pervasive that they can be discussed in 
summary form rather than on an item-by-item basis. Similarly, 
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I the nature of the comments pertaining to Sections 2, 3, and 5, are 

also amenable to discussion in summary form. We shall begin with 
W observations about Sections 2, 3, and 5, since they are more 

m limited in scope. 

Briefly, with respect to Section 2 (Institutional 

■ Enrollments), respondents reported two difficulties. First, 
several pointed out that full-time equivalent enrollments derived 

■ from many sources — e.g., entering freshmen, transfer students, 
m part-time students, continuing-education students, and the like. 

This lead many to be uncertain as to which sources the response 

■ should be based on. Second, respondents felt that several of the 
questions on declining enrollments did not make sense if 

| enrollment decline seemed unlikely in the coming years. 

_ The comments pertaining to Section 3 (Institutional Revenues) 

■ closely parallel those of Section 2. First, respondents remarked 

■ that "when" they saw or heard revenue figures they were seldom 
reported in inflation-adjusted terms. Second, they again noted 

| that several of the questions on revenue decline did not make 

sense if revenue decline seemed unlikely in the coming years. 

■ The criticisms or problems associated with Section 5 (Type of 

■ Institution) were generally of two types. First, respondents 
reported that the point assignment format was confusing. In 

J addition, they reported difficulty in differentiating between 

options within a question. A second and related problem concerned 

■ the descriptions associated with specific labels. For example, 
am respondents commented that the instrument's definition of a 
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"personal place" (question 1A) did not matci their definition of a 
personal place. 

One of the most frequently raise! criticisms or problems with 
the IPS concerned the notion that responses to questions should be 
based on "overall" institutional conditions. Many of the people 
interviewed said they felt reasonably knowledgeable about what was 
happening in their department or school, but had little if any 
sense about overall institutional conditions. While this may be a 
very telling piece of information, it appears to have generated 
both animosity towards the instrument and spurious data. That is, 
several respondents remarked that since they didn't know about 
"overall" conditions in the institution, they simply based their 
responses on conditions in their particular department; whereas 
others in the same department reported that their ratings were 
based on conditions in the institution generally. 

A lesser but related criticism followed from the use of the 
words "institution, school, and college" in the IPS to mean the 
same thing. Respondents reported confusion about the intended 
focus of questions. The nature of this problem becomes clearer 
when one realizes that faculty may reside, for example, in the 
School of Law, School of Management, or the School of Engineering. 
Similarly, one also encounters entities such as the College of 
setters & Science, or the College of Fine Arts. 

The most frequently cited criticism of the instrument 
concerned its failure to have a "Don't Know" response category. 
Failure to include this category may have seriously biased average 
estimates of group perceptions (i.e., mean scores). That is, 
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respondents frequently reported that they assigned a "Neither" 
response when they felt they did not have enough information to 
make an informed decision. Failure to include this category also 
generated a good deal of animosity when respondents felt they were 
being asked questions they believed inappropriate given their role 
in the institution. In particular, many line staff were irritated 
at being asked questions about student development, faculty- 
student relations, faculty satisfaction, and the like. 

The third set of criticisms concerns the use of the terms 
"increasing" and "decreasing" in questions concerning aspects of 
institutional competition, morale, student pool, enrollments, 
innovation, conflict, etc. The primary criticism of questions 
which incorporated this language was that they failed to assess 
current conditions. In addition, respondents said they didn't 
know how to respond when things had pretty much been status quo. 
An often cited example of the problem concerned the question that 
asked whether morale was "increasing." Respondents were uncertain 
as to how they should respond if it had been continuously high or 
low. 

The fourth set of criticisms follow from the use of 
descriptors which many respondents felt were ambiguous or used 
unfamiliar jargon. These include expressions such as "units in 
this institution"— what was the instrument referring to? "Major 
decisions are very centralized"— what constituted a major 
decision? "Top administrators"— who was the inst-ument referring 
to? "Patterns of resource allocation"— drew a total blank. 
"Institution-environment activities" — what was this? 
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Appearance of Validity 

The appearance of validity criterion is primarily concerned 
with the extent to which an instrument appears practical, 
pertinent, and related to its intended uses. Judgment may be 
based on the extent to which consumers believe the instrument 
meets their information needs, and respondents feel that it is a 
worthwhile investment of their time and the institution's money. 
The IPS's primary consumer is the top administrative team and 
persons delegated by them to carry out the study. A second and 
overlapping set of consumers involves those charged with acting on 
the results of the study. 

Comments included with respondents' questionnaires and those 
solicited during interviews yield mixed perceptions regarding the 
quality of the instrument. A sample of these comments are 
reported in Appendix 4. However, the primary issue raised by 
respondents with respect to the utility of the instrument was not 
concerned with its properties, but with what was to be done with 
the results of the endeavor. 

The mirror image of this perception was reflected in the 
opinions held by the primary intended consumers of the IPS--the 
top administrative team, and the president in particular. Their 
opinions regarding the utility of the IPS seemed primarily a 
function of their administrative style, specifically whether or 
not they cared about what their constituencies or respondents 
said— irrespective of whether it was good or bad. As with 
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respondents, the critical factor was not so much the nature or 
quality of the IPS, but whether they had any use for such data. 

Conclusion 

Our conclusions about the face validity of the IPS are 
heavily influenced by the previous discussion on the "appearance 
of validity" criterion. That is, clearly there are problems with 
the language and construction of many of the questions in the 
instrument. However, the factor that appeals to largely determine 
respondents' perceptions of the instrument is their expectations 
regarding if-and-how the results will be used to influence 
existing conditions. 
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Construct Validation 
Construct validation is concerned with developing evidence 
that a test measures a certain variable defined by a theory 
(Cronbach, 1970). This form of validation is ordinarily studied 
when we have no definitive criterion of the attributes or 
qualities with which we are concerned, and instead must use 
indirect measures. The construct validity of an instrument cannot 
be directly assessed. Rather, one must employ different types of 
assessment procedures and data — e.g., analyses of group 
differences, item-analyses, inter-item and scale correlations, 
change over occasions, internal test structure, factor analyses, 
test taking process — that may be regarded as suitable evidence for 
both the existence of the construct and the instrument's ability 
to measure it. 

assessing construct validity is never simple. Assessing the 
construct validity of the IPS is especially difficult because it 
purports to measure many constructs. These include, for example, 
resource allocation, culture, strategy, and effectiveness. 
Furthermore, each section of the IPS includes questions that are 
intended to measure constructs within each of the above noted 
categories. For example, Section 8 (Institutional Effectiveness) 
yields scores on nine different scales: student educational 
satisfaction, student academic development, student career 
development, student personal development, faculty and 
administrator employment satisfaction, professional development 
and quality of the faculty, system openness and community 
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interaction, ability to acquire resources, and organizational 
health. 

Assessment of an instrument's construct validity requires 
many forms of psychometric assessment and data. The assessment 
that follows is certainly not complete. Nonetheless, it provides 
a wide range of information on the question at hand. The analyses 
are based on data collected as a part of the national research 
study for which the IPS was orginally developed. The orginal 
version of the IPS — An Assessment of the Performance of Colleges 
and Universities — was employed in the study. A description of the 
study sample follows. 



■ Sample 

The focus of Organizational Studies' research during 1T83-84 
| was on four-year institutions. Hence, the first criterion for 

_ inclusion in the study was status as a four-year institution. 

Institutions uere subsequently selected on the basis of four 

■ characteristics: enrollment size (200 to 20,000 students), 
institutional control (public versus private), the presence or 

| absence of graduate programs and enrollment change. 

— The fourth criterion, enrollment change, described the 

■ institutions' enrollment trend between 1978-79 and 1981-82. 

■ Institutions were separated into three enrollment change groups: 
growing, stable, and declining. These categories reflected 

J whether full-time equivalent enrollments had grown, remained 

stable, or declined during the specified period. This calculation 

■ was based on the Higher Education General Information Survey 
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(HEGIS) enrollment data. Institutions which experienced declining 
enrollments were overrepresented in the sample to ensure that the 
decline subsample would be large enough for meaningful analyses. 

717 institutions were invited to participate in the study. 
334 institutions agreed to participate, received, and returned 
questionnaires. Table 11 details the participant institution 
characteristics according to the four selection characteristics. 

The number of respondents per institution ranged from one to 
nineteen. Ninety-three percent of the institutions had se^en or 
more respondents. Of the 3,406 total respondents there were 1,321 
administrators (39%), 1,158 faculty (34%) and 927 trustees (27%). 
The average was 4.0 administrators, 3.5 faculty, and 2.8 trustees 
per institution. The overall average was 10.2 respondents per 
institution. Nineteen percent of the respondents were women. 49% 
of the respondents have held their current position for seven or 
more years and 72% have been affiliated with their respective 
institution for six years or longer. 

The form of the questions in the original instrument varied. 
The first seven sections contained questions with five-point 
scales. Possible responses ranged from strongly disagree (1), to 
strongly agree (5). Section 8, which was extracted from Cameron's 
(1978) effectiveness questionnaire, contained questions with 
seven-point scales. These questions were subsequently transfortied 
to five-point scales to maintain consistency with similar types of 
questions in other sections. 
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Table 11 

Number of Institutions in Study Sample 
by Selection Criteria 



Graduate 
Program (s) ? 

Yes 



#FTE 



Enrollment 



No 



Change 


Public 


Private 


Growing 


2 


9 


Stable 


4 


6 


Declining 


8 


7 


Growing 


24 


16 


Stable 


19 


14 


Declining 


8 


10 


Growing 


10 


3 


Stable 


11 


4 


Declining 


5 


1 


Growing 


10 


51 


Stable 


6 


53 


Declining 


5 


20 


Growing 


8 


7 


Stable 


5 


6 


Declining 


2 


0 



127 207 = 334 
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■ Results 
Item Analys i s 

| An examination of the items 1 response rate was made to 

_ determine whether participants failed to respond to any particular 

■ items. A high non-response rate would indicate that an item is 

■ not effectively worded (e.g., it is unclear, intimidating) or that 
it is not applicable to the respondent or the institution. Low 

| response rate items should not be considered valid items and ought 

_ to be excluded from further analyses. Table 12 reports the 

■ response distribution and the number of non-responses for each 

■ questionnaire item. 

Eighty-eight percent of the items had a 98% or better 
B response rate and there appeared to be no pattern to the non- 

responses. Twelve percent (13 items) had a 3-4% non-response 

■ rate. Nine of those items were located in Section 8 and asked 
m respondents to assign a 1-7 rating to each question. In the 

revised questionnaire (the IPS), all questions in Section 8 have 
M been reset to a 5-point scale. 

The other four items with a 3% non-response rate necessitated 

■ knowledge of the presence or absence of enrollment and revenue 

H decline (Section 2 and 3). Follow-up interviews with participants 

indicated that a "Don't Know" response should be added to most 

■ items in a future revised questionnaire. 

The high response rate and variability of responses suggests 
I that D respondents understood the questions, and 2) that the 

_ items can discriminate between institutions that actually differ 

p on the dimensions being assessed — that is, essentially none of the 
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Table 12 
Distribution of Responses and 
Means and Standard Deviations 
for each Iter, (n=3,406) 



Distribution in %* #of Non- 



Section 


Item 


SD 


D 


N 


A 


SA 


responses 


Mean** 


Std.Dev 


1 


1 


7 


35 


12 


42 


4 


39 


3.0 


1.10 




2 


2 


27 


8 


50 


12 


38 


3.4 


1.10 




3 


1 


19 


24 


52 


5 


38 


3.4 


.88 




4 


3 


51 


18 


25 


3 


43 


2.7 


.96 




5 


1 


17 


11 


56 


lb 


34 


3.7 


.97 




6 


1 


5 


3 


50 


40 


41 


4.2 


.82 




7 


17 


47 


9 


24 


4 


41 


2.5 


1.14 




8 


1 




7 


46 


32 


28 


3.9 


1.02 



Distribution in %* #of Nbn- 



Section Item 


Yes 


No 


responses 


2 1 


57 


43 


110 


2A 


28 


72 




2B 


40 


60 




2C 


59 


41 




2D 


74 


26 







Distribution in 
SD D N A 


%* 

SA 


#of Non- 
responses 


Mean** 


Std.Dev 


3 


4 37 14 41 


4 


24 


3.0 


1.04 


4 


20 40 7 26 


7 


16 


2.6 


1.25 


5 


5 26 13 52 


5 


20 


3.3 


1.04 


6 


14 52 10 20 


3 


116 


2.4 


1.05 



Distribution in %* #of Non- 



Section 


Item 


Yes 


No 


responses 


3 


1 


47 


53 


1?,2 




2A 


37 


63 






2B 


54 


46 






2C 


75 


25 






2D 


79 


21 





* excludes non-responces 
*1=SD, 2=D, 3=N, 4=A, 5=SA 



SD 


= strongly disagree 


D 


= disagree 


N 


= neither 


A 


= agree 


SA 


= strongly agree 



~ 51 ~ 70 



; 




Distribution in 


%* 


#of Non- 




1 


^ Section 


Item 


SD 


D 


N 


A 


SA 


responses 


Mean** 


Std.Dev 


■ 3 


3 


3 


28 


11 


52 


5 


25 


3.3 


1.02 




4 


10 


38 


10 


32 


10 


22 


2.9 


1.21 


fl 


5 


9 


35 


11 


43 


3 


21 


3.0 


1.11 


B 


6 


20 


56 


9 


14 


1 


87 


2.2 


.96 


1 




Distribution in 


%* 


#of Non- 






Section 


Item 


SD 


D 


N 


A 


SA 


responses 


Mean** 


Std.Dev 


1 


1 


4 


28 


9 


49 


9 


59 


3.3 


l.li 


■ 


2 


3 


21 


10 


60 


6 


38 


3.4 


.98 




3 


A 

4 


31 


15 


35 


15 


41 


3.2 


1.17 


■ 


4 


2 


9 


8 


59 


23 


32 


3.9 


.90 




5 


1 


6 


7 


68 


19 


29 


4.0 


.73 




6 


3 


18 


11 


56 


11 


37 


3.5 


1.02 




7 


i 


8 


17 


64 


10 


45 


3.7 


.80 


■ 


8 


4 


38 


12 


40 


5 


57 


3.0 


1.07 




9 


3 


22 


10 


48 


16 


40 


3.5 


1.10 




in 


19 


•*r 


9 


18 


8 


32 


2.5 


1.22 




n 


2 


16 


14 


59 


9 


41 


3.6 


.93 


■ 


12 


10 


48 


19 


21 


3 


36 


2.6 


1.01 




13 


4 


41 


17 


30 


7 


36 


2.9 


1.08 


■ 


14 


1* 


55 


12 


15 


4 


34 


2.4 


1.04 




15 


8 


24 


25 


37 


6 


52 


3.1 


1.08 




16 


8 


48 


11 


27 


7 


39 


2.8 


1.13 




17 


3 


36 


23 


33 


5 


42 


3.0 


.99 




18 


6 


18 


17 


48 


11 


37 


3.4 


1.08 


■ 


19 


5 


16 


16 


57 


6 


50 


3.4 


.98 




20 


9 


44 


19 


23 


5 


45 


2.7 


1.08 




21 


5 


42 


18 


30 


5 


45 


2.9 


1.05 


■ 


22 


12 


33 


15 


31 


9 


36 


2.9 


1.21 


■ 




Distribution in 


%* 


#of Non- 






Section 


Item 


SD 


D 


N 


A 


SA 


responses 


Mean** 


Std.Dev 


1 


1 


2 


20 


13 


58 


8 


19 


3.5 


.97 


■ 


2 


3 


31 


22 


39 


4 


23 


3.1 


.99 




3 


1 


12 


13 


64 


10 


25 


3.7 


.85 


■ 


4 


7 


53 


20 


18 


1 


32 


2.5 


.92 


■ 


5 


5 


47 

< 


18 


27 


3 


27 


2.7 


1.00 


*excludes non- 


responses 












1=SD, 


2=D, 3=N, 4= 


=A, 5 


=SA 












■ SD 


= strongly disagree 












■ D 


= disagree 
















N 


= neither 
















■ A 


= agree 


















g SA 


= strongly agree 
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Distribution in %* #of Non- 
Section Item SD D N A SA responses Mean** Std.Dev 



6 


9 


37 


20 


30 


4 


24 


2.S 


1.07 


-7 


2 


10 


10 


64 


14 


22 


3.8 


.88 


8 


1 


13 


16 


62 


8 


23 


3.6 


.85 


9 


2 


21 


22 


52 


3 


42 


3.3 


.90 


10 


5 


14 


22 


49 


10 


36 


3.4 


1.02 


11 


6 


36 


24 


30 


4 


27 


2.9 


1.03 


12 


7 


21 


13 


49 


10 


24 


3.3 


1.11 


13 


2 


9 


8 


62 


19 


27 


3.9 


.90 


14 


6 


31 


24 


36 


3 


27 


3.0 


1.02 




Distribution 


in 


%* 


#of Non- 








1 


2 


3 


4 




responses 






15 


44 


30 


8 


18 




61 






16 


12 


8 


29 


51 




51 








Distribution 


in 


%* 


#of Non- 







Item 


SD 


D 


N 


A 


SA 


responses 


Mean** 


Std.Dev 


1 


6 


28 


14 


48 


4 


28 


3.2 


1.06 


2 


16 


51 


8 


18 


7 


15 


2.5 


1.15 


3 


7 


27 


17 


47 


3 


39 


3.1 


1.05 


4 


5 


15 


13 


62 


6 


24 


3.5 


.98 


5 


12 


54 


11 


19 


3 


25 


2.5 


1.04 


6 


14 


42 


15 


23 


6 


27 


2.6 


1.14 


7 


10 


42 


17 


27 


3 


32 


2.7 


1.07 


8 


15 


46 


16 


18 


5 


36 


2.5 


1.11 


9 


7 


24 


15 


50 


5 


27 


3.2 


1.07 


10 


3 


12 


13 


60 


11 


33 


3.6 


.95 


11 


34 


47 


11 


7 


2 


24 


1.9 


.93 


12 


7 


30 


21 


38 


3 


28 


3.0 


1.05 







Distribution in 


%* 


#of Non- 






Section 


Item 


SD D N A 


SA 


responses 


Mean** 


Std.Dev 


8 


1 


1 10 8 53 


27 


20 


4.0 


.93 




2 


1 21 21 50 


6 


27 


3.4 


.93 




3 


10 43 17 25 


4 


18 


2.7 


1.08 




4 


19 49 16 14 


2 


19 


2.3 


1.00 



"excludes non-responses 
*1=SD, 2=D, 3=N, 4=A, 5=SA 
SD = strongly disagree 

D ■ disagree 

N = neither 

A = agree 

SA ■ strongly agree 
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Distribution in %* #of Non- 
Section Item SD D N A SA responses Mean** Std.Dev 



REV. 5 


2 


8 


11 


58 


21 


21 


3 9 


89 


REV. 6 


2 


9 


10 


55 


24 


18 


3.9 


.91 


REV. 7 


1 


7 


9 


57 


25 


20 


H m V 


ftft 


8 


4 


24 


19 


45 


8 


17 


3.3 


1.04 


9 


3 


25 


23 


43 


6 


25 


3.2 


.99 


10 


2 


15 


19 


56 


8 


21 


3 5 


9? 


11 


4 


25 


21 


43 


7 


24 


3.2 


1.04 




Distribution in 


%* 




Mean** 
neon 






1 


2 


3 


4 


5 


L C&^AJl iocs 


OL.U • UcV 


REV. 12 


0 


7 


29 


60 


4 




3 


• DO 


REV. 13 


12 


59 


16 


12 


0 


111 
±.±.±. 


9 3 


ft4 
• 0*4 




Distribution in %* 


ffui iiUii 








None 








All 


L Co^AJi Iocs 


Moan** 


o uu • uev 


14 


0 


56 


20 


23 


1 


78 


9 7 


• OO 


15 


0 


13 


18 


68 


1 


158 




73 

• 13 


16 


0 


7 


11 


77 


5 


64 


3.8 


.64 


17 


0 


13 


13 


69 


5 


129 


3.6 


.78 


REV. 18 


0 


11 


11 


77 


1 


70 


3.7 


• \J\J 


REV. 19 


1 


11 


10 


73 


5 


66 


3.7 


.11 


20 


0 


12 


14 


74 


11 


60 


3.6 


.70 


21 


0 


10 


12 


73 


4 


65 


3 7 


70 


22 


0 


67 


16 


17 


0 


81 




11 

mil 


23 


0 


36 


22 


41 


1 


84 


3 1 




24 


0 


46 


20 


33 


0 


72 




ftQ 

• 07 


25 


1 


51 


20 


29 


0 


1 21 


9 ft 


ftft 
• oo 




Distribution in %* 


#of Non- 


Mean** 






1 


2 


3 


4 


5 


responses 


Std.Dev 


REV.26 


1 


8 


10 


67 


15 


20 


3.9 


.77 


REV. 27 


2 


11 


12 


68 


8 


20 


3.7 


.83 


REV.28 


1 


12 


13 


65 


3 


20 


3.7 


.85 


29 


4 


23 


14 


54 


6 


22 


3.3 


1.01 


30 


2 


23 


20 


53 


2 


35 


3.3 


.91 


REV. 31 


2 


17 


15 


62 


4 


27 


3.5 


.87 


REV. 32 


1 


14 


14 


59 


12 


25 


3.7 


.89 



*excludes non-responses 

■ **1=SD, 2=D, 3=N, 4=A, 5=SA 

■ SD = strongly disagree 

D = disagree 
m N = neither 

■ A = agree 

SA = strongly agree 
* *Items 12-32 were rescaled from an original scale of 1-7 to 1-5 

■ (1=1) (2,3=2) (4=3) (5 r 6=4) (7=5) 

REV. means that the scale of item was reversed 
- O (i.e., 1=5,2=4,4=2,5=1) 
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items aru ranked the same by all respondents. An item ranked the 
same by all respondents would provide no useful information. 

Factor Structure and Internal Consistency 

Five of the eight sections of the IPS (Sections 1, 2, 3, 4, 
and 6) include questions that purport to measure relatively 
unrelated dimensions or constructs. Two ways of assessing the 
extent to which this is true include examination of 1) the 
correlations between items in each section; and 2) the factors 
these correlations yield. Low correlations between items in the 
same section would be evidence that each item measures a 
relatively unique construct or dimension. Similarly, poorly 
defined factors (i.e., in terms of a "simple structure" 
criterion) would also be evidence that individual items are 
measuring relatively unique dimensions. 1 

The correlations between the items in Section 1 calculated at 
the respondent level are reported in Table 13A-Part 1. 
Correlations based on institution-level data (i.e., institutional 
mean scores) are reported in Table 13A-Part 2. The results of the 
factor analysis for the items in Section 1 are reported in Table 
13B. Part 1 in Table 13B reports respondent level results; Part 
2 reports institution-level results. The results of similar 
analyses for Sections 2, 3, 4, and 6, are reported in Tables 14A 

^The simple structure criterion (Comrey, 1973, p. 108) suggests" 
that a factor is poorly defined unless 1) most of the loadings on 
a given factor are small, that is, more or less randomly 
distributed about zero, with only a few of the loadings being of 
substantial size; 2) any given row of the factor matrix has 
nonzero entries in only a few columns; and 3) any two factors 
exhibit different patterns of high and low .loadings. 
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Table 13 A 



Section 1 Part 1 

correlation coEFMciEMi & .at the respondent level 



SI I 
812 
St3 
314 
319 
316 
317 
818 



SI I 

1 .00000 
-.31898 

.24321 
-.12222 

. 00617 
-. 014*1 

. 05090 
- . 03667 



312 



-.31893 



SI3 



30000 
12361 
17264 
04729 
05411 
05860 
19941 



.24321 
.12361 
. 00000 
.03351 
. 08739 
I 1607 
01224 
, 00805 



314 

- . 1 2222 
. 1 7264 
-.08351 



ss: 



SI6 



I 



00000 
16553 
10211 
04236 
10526 



.00617 
. 04729 
. 08739 
. 16553 
. U0000 
.49586 
.16994 
.10048 



.01401 
.05411 
. 1 1607 
. 1021 I 
. 49536 
. 00000 
.27838 
.11116 



SI7 



.05090 
. 05360 
. 01224 
. 04236 
. 169*4 
.27333 
. 00000 
. 0323 I 



SI3 



. 03667 
. 19541 
. 00805 
. I 0526 
.10048 
.11116 
.08281 
00008 



DETERMINANT OF CORRELATION MATRIX » .5034003< . 50340033E+00 > 



Part 2 



Section 1 



CORRELATION COEFFICIENTS, at the 

1 


institution 


level 












SI 1 


312 


813 


314 


S15 


SI6 


SI7 


S18 


811 'j 

312 

813 

814 

319 

816 

817 

818 i 


1 . 00000 
-.49090 
.24749 
-.10246 
. 13621 
. 1 0402 
. 03375 
. 00267 


-.49090 
1 .00000 
-♦17950 

♦ 09280 
-.16671 
14054 
-.04840 

.28551 


.24745 

-.1/950 
1 .00000 
.00410 
. 19527 
. 1 3925 
.04390 
. 0,3382 


-,10246 

.1)9280 
.00410 

1 .00000 
.23565 
. 19386 

-.15052 
.05611 


.13621 
-.16671 

.19527 

.28565 
1 . 00000 

.69258 
-.42831 

. 05578 


, 1 04 C2 
-. 14054 

. 1 3925 
. 19386 
. 69258 
1 . 00000 
-.54419 
-.01714 


. 03375 
-. 04340 

. 04390 
-. 15052 
-.42331 
-.54419 
1 . 00000 

. 00060 


. 00267 
.23551 
. 03382 
. 0561 1 
. 05578 

-.01714 
. 00068 

1 . 00000 


DETERMINANT OF 


CORRELATION 


MATRIX - . I303927< 


. I80&927IE + 00J 











I 



ERIC 



75 



Table 13 B 



Part 1 
Section 1 

VARIMAX ROTATED FACTOR MATRIX 

at the respondent level 







FACTOR 1 


FACTOR 2 


SI 1 




-.01263 


.56575 


812 




.11311 


-.55354 


513 




. 12724 


. 34458 


814 




.16576 


-.25/00 


$!5 




.62755 


.01776 


916 




. 76676 


.0435/ 


S1? 




-.31576 


. 06749 


318 




. 17747 


-.16103 


TRANSFORMATION MATRIX 








FACTOR 1 


FACTOR 2 


FAC 


1 


.97692 


-.21363 


FA' u* 


2 


.2136? 


.97692 



Part 2 
Section 1 

VARIMAX ROTATED FACTOR MATRIX 

at the institution level 







FACTOR 1 


FACTOR 2 


FACTOR 3 


St 1 




-.03231 


.66446 


-.03969 


S12 




.00371 


-.64677 


. 5886 1 


S13 




.071*7 


.38829 


. 08?99 


S14 




.29775 


- . 06639 


. 10906 


S15 




.77435 


.28895 


. 05858 


S16 




.65166 


.1/515 


-.0/950 


sir 




-.6128? 


. 09647 


. 04744 


£16 




.02313 


.03531 


.51038 


TRANSFORMATION MATRIX 










FACTOR t 


FACTOR 2 


FACTOR 3 


FACTOR 


1 


.90747 


.40346 


-.11702 


FACTOR 


2 


.40396 


-.76166 


.5066> 


FACTOR 


3 


-.11526 


.50702 


.65419 



BEST COPY AVAILABLE 



through 17B, respectively. The results of these analyses strongly 
suggest that the items contained in each of the sections measure 
relatively unique constructs or dimensions. 

The questions in Section 5 are concerned with assessing the 
type or types of culture that exist in an institution. The four 
questions in this section are concerned with general institutional 
culture, leadership, cohesion, and emphases. Each question listed 
four characteristics; each of these characteristics is indicative 
of one of four types of cultures. On each question respondents 
were asked to parcel 100 points among the four types of 
characteristics (cultures), as an indication of the extent to 
which each description was reflected in their institution. 
Throughout the four questions the following characteristics 
represented these cultures: 



Item Culture Characteristic 



Clan 



B Emergent 
System 



C Hierarchy 



A clan is much like a family; it is highly 
personal and formal. Loyalty and tradition are 
bonding forces and morale is usually high. Clans 
are usually led by father or mother figures or 
by mentors. 

An emergent system is dynamic and entrepreneurial 
it emphasizes innovation and new ideas. This 
kind of institution is strongly committed to 
development and progress, and its leader is 
usually an innovator or entreprenuer . 

A hierarchy is a formalized, tightly structured 
institution governed by formal rules and 
procedures. As archetypal bureaucracies, such 
institutions emphasize efficient, well-oiled 
processes. They value stability and permanence. 
Hierarchies are usually led by organizers and 
coordinators. 
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Table 14 A 



Part 1 

Section 2 

correlation coeff i c I en rs .3 1 the respondent level 



S23 
824 

S25 
S26 



S23 

I . 00000 
-.0tlt2 
.10731 
-.11426 



S24 



.01! 12 
. 00000 
. 19997 
.20962 



$25 

. 10731 

-.1999? 
t . 00000 
. 05815 



$26 

-.11423 
-.20962 
. 05315 
1 . 00000 



DETERMINANT OF CORRELATION MATRIX * 



. 69344 07< 



. 89344 072E* 00 > 



Part 2 

Section 2 

correlation COEFFICIENTS. at the institution level 



S23 
S-C'4 
$25 
526 



S23 

1 .00000 
0I92J< 
. 0*614 
-.20413 



S24 

-. 01923 
I . 00000 
-.3201 1 
-.29544 



S25 

. 0*614 
-.32011 
I . 00000 

. 06446 



S26 

-.20413 
-.29544 
. 06443 
1 .00000 



PETERMINAMT OF CORRELATION MATRIX 



221 43< .77221 429E+00* 
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Table 14 B 



Part 1 



Section 2 

VAF.1MAX ROTATED FACTOR MATRIX 

at the respondent level 



FACTOR f FACTOR 2 

523 . 02720 .38703 

524 -.54377 .01139 

525 .37259 .25349 

526 .37670 -.32130 



TRANSFORMATION MATRIX 



FACTOR 1 
FACTOR 2 



FACTOR 1 

.9964 0 
. 08474 



FACTOR 2 

- . 08474 
.9964 0 



Part 2 



Section 2 

VARlMAX ROTATED FACTOR MATRIX 

at the institution level 



FACTOR t 



FACTOR 2 



S23 
S24 
S25 
£26 



. 1 229* 
.70767 
.47631 
.26433 



.39074 
. (7669 
.10033 
-.60474 



TRANSFORMATION MATRIX 



FACTOR 1 FACTOR 2 

FACTOR 1 .83224 -.47030 

FACTOR 2 .47030 .83224 
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Table 15 A 



Fart 1 

Section 3 

correlation coefficients, .at the respondeat level 



S33 



S33 
$'34 
S35 
S3* 



,00000 
, 1 043^ 
, 1 1164 
. 0037.' 



S34 

- . 1 043? 
t .00000 
-.18713 
-.25244 



S35 



11164 

13715 

, ooooo 

17677 



S36 

-.00377 
-.25244 
.17677 
1 .00000 



DETERMINANT OF CORRELATION MATRIX 



.367507«K .86750793E+00 > 



Part 2 

Section 3 

correlation coeffic ients. at the institution level 



*33 
S34 
633 
S3* 



S33 

I . 00000 
-.14561 
. 151 01 
-.02247 



S34 

-.14561 
I . 00000 
-.32431 
-.42854 



S35 

. 151 01 

-.32431 
1 . OOOOO 
.25260 



S36 

- . 02247 
-.42S54 
.25260 
I . 00000 



DETERMINANT OF CORRELATION MATRIX - 



. 665 0772< . 665 077 1 9E ♦ 0 0 ) 
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Table 15 B 



Part 1 
Section 3 

VAR1MAX ROTATED FACTOR MATRIX 

at the respondent level 



FACTOR 1 FACTOR 2 



S33 
S34 

S35 

S3* 



. 04496 
-.45304 
.32560 
.5835* 



.44020 
.18918 
.21846 

• . 06598 



TRANSFORMATION MATRIX 



FACTOR 1 FACTOR 2 



FACTOR 1 
FACTOR 2 



,94947 
3138*5 



,31385 
.94947 



Part 2 

Section 3 

VARIHAX ROTATED FACTOR MATRIX 

at the institution level 



S33 
535 



FACTOR 1 

. 04 049 
-.6483* 
.40014 
.69304 



FACTOR 2 

.490S 
-.2421 1 
. 27286 
10149 



TRANSFORMATION MATRIX 



FACTOR 1 FACTOR 2 



FACTOR 1 
FACTOR 2 



.96095 
27671 



,27671 
.96095 



o 
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BEST COPY AVAILABLE 



Part 1 



Section 4 

correlation COEFFICIENTS, at the respondent level 

■i 





$401 


3402 


3403 


84 04 


§4*1 


1 .00000 


. 19668 


.00360 


* . 03695 


§402 


. 19669 


1 . 00000 


.05890 


. 13237 


§403 


. 00360 


. 05890 


1 . 00000 


.51421 


§484 


- . 03693 


. 13237 


.51421 


1 .00000 


t'.m 


-.07433 


. 12496 


•^0461 


.52755 


$40* 


-. 1 J880 


. 8699 


.33608 


.56372 




- . 06773 


. 1 1742 


.21 121 


.34598 


64 oe 


. 06619 


-.29901 


-.10247 


-.24132 


$409 . 


.6*079 


.01567 


- . 03483 


-.04863 


3410 


. 04631 


-.23606 


-. 1291* 


-.26313 


§411 


- . 08352 


.10149 


. 15649 


.26135 


8412 


. 0246 1 


03316 


- . 0423? 


-.03590 


§413 


. 09'43 


- . 0877* 


-.1 1972 


-.21696 


S4I4 


. 0<,76 1 


-. 0936? 


-.03&39 


-. 14459 


9413 


<4623 




1 "i TAtt 
. 1 JJUW 


• 26J"6 


8416 


-.09085 


. 03790 


. 0488? 


. 03744 


8417 


. 14486 


-.03226 


-.07030 


-.14981 


$4 It 


-. 12660 


. 19208 


. 18332 


.34400 


§419 • 


- 08193 


. 19801 


. 12946 


.24008 


$420 


. 14718 


-. *5294 


-.133 03 


- 27151 


$421 


. 1 589 


-.026^4 


-.03306 


-. 16750 


8422 


.03791 


.01493 


. 05551 


. 05505 




S411 


3412 


3413 


8414 


8401 


- . 08652 


. 02464 


. 09343 


. 06761 


34 02 


. 1 0149 


-.03316 


-.03779 


- . 0936? 


8403 


. 15649 


-.04237 


-.11972 


-. 03039 


8404 


.26135 


-. 08590 


-.21696 


-.14459 


84 03 


.26783 


-.07-*»2 


-.23637 


19132 


1:406 


• .29836 


-. 16469 


-.35496 


-.22723 


8407 


.26575 


-.0919? 


- . 2366 1 


-.20553 


$4 08 


-.23643 


. 14463 


.23755 


, 1377? 


8409 ) 


-. 1 1004 


. 033*? 


.•1711 


. 1253? 


8410 ' 


-.32152 


.14459 


. 34522 


.21 1 16 


8411 


1 . 00000 


- . 06353 


- . 26984 


-.09317 


8412 


- . 06653 


1 . 00000 


.30623 


.20446 


8413 


-.26984 


.30625 


1 . oouoo 


. 1 6396 


$414 


-.09317 


.20446 


• 16396 


1 . 00000 



$4 05 


3406 


S4 07 


S4 08 


S4 09 


34 1 0 


-.07433 


1 I88f; 


- . 06773 


. 0661 9 


• 09 079 




. 12496 


. 1 8699 


. 1 1 742 


- . 29901 


. 0 1 567 


< « JO w 


.30461 


. 336 08 


.21 121 


- # | 024 ? 


- . 03435 


. 1*71 ? 


.52755 


.56372 


.34598 


- . 241 32 


- • 04363 




1 . 00000 


.55215 


.34354 


- . 22776 


- . 1 0391 


. a. 1 r 


.55215 


1 . 00000 


.42342 


- . 35369 


- . 1 0470 




.34334 


.42842 


1 . 00000 


-.27967 


- . 1 0536 


. «# Vft 


-.22776 


- . 35869 


-.2796? 


1 . 00000 


. 1 1 09? 


. 367 1 9 


-.1 0891 


-. 1 0470 


- . 1 05w6 


. 1 1 097 


1 . 00000 


. 18435 


-.29317 


-.35485 


-.304 02 


.36719 


. 13485 


1 . 00000 


.26733 


.29336 


.26575 


- .2 "645 


- . 1 1 U04 


- . 32 1 52 


- . 07422 


-.16469 


-.0919? 


. 14463 


. 03397 


. 14459 


-.23637 


- . 35496 


-.23661 


. 28753 


.11711 


.34522 


-.19132 


-.22728 


-.20553 


. 1377? 


. 1253? 


.21 1 16 


. a. r 


• 358 1 0 


. 323 01 


- . 27689 


-.16913 


-.35360 


. 07636 


.03312 


. 02149 


-.02967 


- . 00365 


- . 02337 


- . 1 7389 


-.25650 


-.15693 


. 19923 


. 05666 


. 2 ^892 


.33124 


.42917 


.37130 


-.36830 


- . 17770 


- .4i.44 1 


.233£5 


.34333 


.23749 


-.23350 


- . 1 1 1 74 


- . i94 0 1 


-.2931? 


- . 33674 


-.31366 


.3142? 


. 16752 


. 39834 


-.16750 


-.23509 


-.22232 


. 17039 


. 1 3466 


. 27353 


. 06066 


. 07919 


. 05357 


. 00659 


-. f . 462 


, 0033 1 


S4I3 


3416 


S4I? 


$418 


S419 


$420 


-. 1462"5 


-.09035 


. 14486 


-. 126t>0 


-.03193 


. 14713 


. 11312 


. 03790 


- . 03226 


. 19203 


. 19301 


- . 1 5294 


. 15303 


.04387 


-.07030 


. 18332 


. 1 2946 


-. 13303 


.26346 


. 03744 


-. 14981 


.34400 


.24003 


-.27151 


.27265 


. 07636 


- . 1 7389 


.33124 


. 26365 


-.29317 


.35310 


.08512 


-.25650 


.4291"* 


.34333 


- . 38674 


.32501 


.02149 


-.15693 


.37130 


.28749 


-.31366 


- . 27689 


- . 02967 


. 19923 


-.363o0 


-.23350 


.3142? 


-. 16913 


-.00363 


. 05666 


-.1 ???0 


1 1 174 


. 16752 


-.35360 


-. o?ee? 


.20392 


-.42441 


-.394 01 


.39334 


.44732 


. '16582 


-. 15469 


.4 0996 


.34215 


-.3734 0 


-. 14361 


.02781 


.26335 


-. 13913 


-.0731? 


.2450? 


- . 33999 


-. 04b?3 


. 2 .*223 


- . 35*44 


- . 2*52 0 


.42226 


-.17746 


. 0255? 


.16211 


-.22333 


16*30 


. 2*»to?2 
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Table 16 A 



Part 1 
(continued) 



$415 
$41t 
S4I7 
$419 
$419 
$420 
$421 
$422 



S41 1 

.44732 
. 0653*? 

15469 
.40996 
.34215 
-.37340 
-.22339 
. 01316 



S412 

-.14361 
.02731 
. 26835 
18918 

-.07317 
.24507 
. 12508 

-.00995 



$413 


$414 


3415 


S416 


S417 


- . 33999 


- . 1 7748 


1 . 00000 


. 05028 


-.28746 


04677 


. 02557 


.05023 


1 . 00000 


-.07792 


.29223 


. 1*21 1 


-.23746 


- . 07792 


! .00000 


- . 35544 


-.22333 


.55353 


. 03502 


-.23513 


-.26520 


-.16930 


.33073 


. 08306 


-.21606 


. 42226 


.24672 


- . 622 1 0 


-.05332 


.45502 


.20257 


. 1 1317 


-.30489 


. 1 1360 


. 196 70 


-. 0503? 


-. 14332 


-01372 


-.05533 


. 01297 



$413 



. 55353 
. 03502 
.23513 
. 00000 
.47734 
.56253 
,32505 
, 02457 



S4I9 

.38073 
. 03306 
-.21606 
.47734 
1 . 00000 
-.43959 
-.23629 
-.01756 



3420 



.6221 0 
. 05332 
45502 
.56253 
. 43959 
. 00000 
30193 
00045 



S421 



$422 



$401 

$402 

$403 

S40I 

$405 

$406 

$407 

$408 

$409 

$410 

$41 1 

$4*2 

$413 

$414 

$415 

$416 

$417 

$418 

$419 

$420 

$421 

$422 



. 1 1589 
- . 02674 
-.08306 
-. 16750 
- . 1 6750 
-.23509 
- . 22232 
.17039 
. 1 3466 
.27353 
-.22339 
.12506 
.20257 
. 1 1317 
-.30439 
. 1 1360 
.19670 
-.32505 
-.23629 
.30193 
I . OOHOO 
. 03 *39 



.03791 
. 01493 
.05551 
. 05505 
. 06066 
.07919 
. 058T- 
, 00659 
. 01462 
.00331 
. 01316 
. 00995 
. 05082 
.14382 
. 01372 
, 05533 
• 01297 
, 02457 
01756 
00045 
03939 
00000 
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Table 16 A 



Section 4 

correlation COEFFICIENTS. 3t the institution level 



Part 2 



34 <M 

$402 

34 ©3 

3404 

3403 

S406 

3407 

£408 

3409 

341 0 

341 f 

3412 

3413 

3414 

3415 

3416 

341? 

3418 

S419 

3420 

3421 

3422 



S401 

1 . 00000 
.24691 
.09612 
. 02239 
-.06024 
-. 1<M85 
-.07440 
.0919/ 
. 19177 
. 1 1306 
135^ 
. 04161 
. J 9612 
. 0193* 
-.2159* 
-.23/43 
.24719 
- . 22456 
-.2091 1 
. ">9*90 
. 1j«I 
.10310 



S4 02 

.24691 

1 . 00000 
. 0159? 
. 10437 
!9425 
. 13331 
. 11 79 J 

- . 39246 
. 00532 

-.15147 
. 02095 

-. 04378 
. 12060 
20693 
. 07770 
, 00521 
. 00461 
. 08675 
. 12099 

-.04130 
, 07543 
. 01655 



34 03 



. 09612 
. 0153 < 

1 . 00000 
.75184 
. 43976 
,5794*. 
.23*18 

-. 17434 
. 0"i576 

-.03323 
. 17773 
17129 

-. 19006 

-.01551 
. 16770 
. 01210 

-. 17442 
.2131% 
. 15193 

-. 1603/ 

-. 1 1374 
. 1 09/3 



S4 04 

. 02239 
. 1 049/ 
.75194 
1 . 00000 
.6931 1 
.75053 
.47/40 
-.34044 
-. 02521 
-.29039 
. 253 >9 
- . 263 I 2 
-.30943 
-.21549 
.28533 
-.00377 
-.23853 
.43156 
. 27932 
-.72199 
-.24/52 
. 14600 



C-4 05 

-03024 
. 1 9425 
. 43876 
. 699 1 1 
1 . 00000 
.6965/ 
.50442 
-.3/616 
-. *0530 
-.331 02 
.2701 0 
-.2522 J 
-.70770 
-.36715 
.27/18 
. 0678/ 
-.28498 
.40554 
.3703/ 
-.33030 
-. 12351 
. 13/00 



S406 

-. 14435 
.13831 
.5/945 
.75053 
. 69657 
I . 00000 
, 53565 
-.5050* 
-. 1 0650 
-.40185 
.30037 
-.36946 
-.4 0903 
-.2*374 
.4 033* 
. T4030 
-.4,3l9Cc 
.5199'* 
. 4 I 836 
-.43049 
- . 23963 
. 16032 



*4 07 


S4 03 




4 09 




4 1 0 


- . 0744 0 




. 08 1 87 




. 19177 




. 1 1306 


• i 1 < * J 




. 39246 




. 00582 


- 


. 1514/ 


. 233 1 




. 1 7434 




. 05576 


- 


. 03327 


. 47/4 0 




. 34 044 




. 0 A '521 


- 


29033 


. 5 04 4 2 




. 3/616 


■* 


. 1 0530 


- 


.331 02 


. 0<<w'60 




. 50503 


— 


. 1 0650 


- 


.40185 


1 ft ft n fi ft 




. 33358 




. 14339 


- 


. 36982 


- . J .5 d 5 3 




. 000 0 0 




. 02*46 




.43373 






. 02*46 


1 


.00000 




13130 


— . 36932 




.43373 




.13130 


1 


. 00000 






27275 




.01910 




.29126 


-.30441 




29762 




. 06*96 




.40151 


-.23/02 




34321 




. 1 1 092 




.45785 


-.41 153 




2316* 




. 151-93 




. 32836 


. 33641 




32i ~*4 




. '2762 




. 352*6 


-.20466 




05*16 




. 02343 




.201 13 


-.29617 




34301 




. 0041 (i 




. 32675 


. 462 9 3 




43174 




.21529 




.45167 


. 36326 




35322. 




1 1501 




.33444 


-.34 057 




37330 




. 18517 




4 0629 


-.23163 




25900 




0*003 




43191 


. 1 3249 




01203 




01*91 




00167 



S40t 
3402 
3403 
3404 
3405 
3406 
340/ 
3408 
3409 
3410 
341 1 
3412 
3413 
3414 



S41 1 

.4552 
. 02035 
. 1777 J 
. 25359 
.27010 
.3003/ 
.24460 
-.27275 
-.01910 
-.29126 
1 . 00000 
-.19234 
-.3612S 
-.0030/ 



S412 

. 04 1 6 1 
-. 04378 
-. 17129 
-.26812 
-.25223 
-.36046 
-.30441 
.23/62 
. 06696 
.40151 
-, 19234 
1 . 00000 
. 52226 
. 32394 



3413 

. 19612 
. 12060 
-. 1900* 
-.30948 
-.307/0 
-. 4fi*08 
-.28/02 
.34321 
. 1 1 092 
.45735 
-.3612S 
. 52226 
t . 00000 
. 1893*-' 



3414 

. 0 1 332 
-.20693 
-. 01551 
-.21549 
-.36715 
-.293/4 
-.41 153 
.23169 
. 15293 
. 32336 
-. 0 030? 
.323*4 
. 1393/ 
1 . 00000 



S415 

-.21593 
. 0/770 
. 16770 
. 28533 
.27/13 
.40336 
. 33641 
- . 32634 
-. 12762 
- . 35296 
.53496 
-.39953 
- . 3*625 
-. 1 170/ 



S416 

-.23743 
. 00521 
.01218 

-.00377 
. 0673/ 
.04 030 

-.20466 

-.05816 
. 02343 
.201 13 
. 0366,? 
. 1 084 1 
. 0081/ 
. 07360 



S417 

.24719 

. U0461 
-. ' 7442 
-.29853 
2*493 
-.43198 
-.2*61 7 

.34301 
0041 0 

. 326/5 
-.2*306 

.50:-. 9 

.<«66*! 

. 15447 



S413 



. 22456 
. 086/5 
.21315 
.43156 
.4 0554 
.51*99 
.46210 
.43174 
.21529 

45167 
.471 13 

51341 
.56353 
,264*0 



$41* 

-.2031 1 
. 12u3»* 
.15193 
. 27*32 
.37037 
. 4 1 386 
. 36326 
- . 35322 
1 1501 
-.33444 
. 36573 
- . 2T663 
-3//21 
-.242'6* 



?420 

.239*0 
-. U4130 
-. 16087 

.321*9 
-33090 
-.4304? 
- 34 05/ 

.3/390 

1 35 1 r 

.4 062* 
.46743 
f 66 03 
5/2 14 
. ** 266 0 
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Table 16 A 



Part 2 
(Continued) 



MIS 
5416 
Ml? 
5415 
5419 
5420 
S421 
$422 



S4M 

.58496 

. 03662 
-.29306 
.47113 
. 36573 
-.46743 
- . 33849 
-.01394 



S412 

- . 39933 
.10341 
.50879 
-.51341 
-.27663 
.56603 
.36230 
. 02351 



S4I3 

- . 39625 
.00317 
. 46*.' 6 1 

-.56313 

.57234 
.34370 



S4 14 

! 1707 
.07360 
. 15447 
-.26490 
-.24269 
.22660 
. 10901 
-.26135 



3415 

t . 00000 
. 04 I 73 

-.43 03;* 
.64799 
.43320 

- . 75542 

-.47518 
Obf.71 



34 16 



3417 



. 04 1 73 
. OUUOO 
. 01 022 
. 06959 
. 04035 
. 022 1 3 
. 30«."92 
. 15312 



.43033 
. 01022 
. U0000 
.4SM94 
. 34516 
.67353 
,3464u 
.02237 



S413 

.64 799 

. 0*9*9 
-.49194 
1 . 00000 

.6 0(M9 
-.72173 
-.47931 

. 02366 



S419 

.43320 
. 03035 
-34516 
.60039 
1 . 00000 
-.47773 
-.33237 
-.00393 



S4«'0 

- . 75542 
-.02213 
. 67353 
-.721 73 
-.4 7773 
1 . 0U000 
.4^591 
.01330 



1 

o> 
1 



5401 

S4 02 

S403 

S404 

54 03 

54 06 

S407 

54 0* 

$4 09 

S410 

5411 

5412 

5413 

5414 

5413 

5416 

5417 

5415 

5419 

5421 

5421 

5424 



$421 

.15551 
. 0754* 
- . 11 374 
-.24752 
-. 12351 
-.239*3 
-.2316? 
.25900 
, 09008 
.43191 
-.33349 
.36230 
.34370 
. 10901 
-.47515 
.30292 
.3464 0 
-.47981 
-.33237 
.43591 
I . 00400 
. 06497 



S422 



.10310 

.01635 

. 1 0973 

. 14600 

. 13700 

. 16032 

.13249 

.01203 

.01991 

.00167 

.01394 

.02351 

.10197 

.26185 

.06571 

. 15312 

. 0223? 

. 02366 

,00393 

* 01330 

, 0649? 

.00000 
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Table 16 B 



Part 1 



Section 4 

VARIMAX ROTATED FACTOR MATRIX 

at the respondent level 





C/»r T ft 13 1 

rRwTOK I 


FACTOR z 


FAC TOR 3 


FmCTuR 4 


FACTOR 5 


FACTOR 


U 1 


• • 1 tOJ™ 


* 00258 




. 07362 


. 37387 


. 06441 


-.13543 


AO 


. 1 


. 056 • 9 


- 


. 026*9 


. 66£&6 


- . • 0864 


. tOt 04 


C4 ft"! 




. 53 ,57© 


- 


. C2933 


. 027 16 


. 03621 


-. 00948 


U't 


9 A4 


. W 1 JbP 


- 


. 07738 


. 05409 


- . 0925 7 


-.00723 




. «► ?4*Zf 


.53823 


- 


. 06039 


- . 0 • • 24 


-.25166 


. \ 1634 


Mb 


• Job 05 


• 1 44 


- 


. 19435 


• 02554 


-. 32690 


.1431 ( 


ft "7 


TAA 1 1 

• o 70 1 1 


. J 1 P Jr 




. 06935 


. 0034 1 


- .23301 


. 00700 


34 03 


-. 39t 79 


- • t t 767 




.17030 


* ttoo r 


. 2597 7 


— . I0t 84 


S409 


-.24831 


.01035 




. 013*4 


.10913 


. 14261 


.01316 


S4I0 


-.53416 


12838 




. 14013 


-.15285 


. 23679 


- . 03697 


S4I 1 


.53278 


.19421 




. 04771 


-.00250 


. 04 006 


. 05234 


S4t2 


-.05789 


-.02225 




.34326 


-.01590 


. 1325! 


. 07782 


S4I3 


-.354 IB 


13518 




.41346 


-.00483 


. 14729 


-. 04934 


S4I4 


-. »9763 


-.05530 




.23000 


-.01 • 15 


.33022 


. 03849 


34 1 5 


.69480 


.13872 




.22806 


-.05441 


. 1301 1 


.01473 


34 16 


. 02349 


.05856 




. 01774 


-.02469 


.07614 


.53084 


S4I7 


-.23594 


-.07571 




.50063 


.031 1 t 


. 00738 


U5t6 


S4t8 


.67*30 


.20802 




.21492 


. 04492 


- . 063 • 4 


. 07583 


3419 


.56466 


.13900 




. 08501 


. 09593 


-.07400 


. 1 3287 


S420 


-.65048 


-.13472 




. 46423 


.00913 


-.06960 


-.06019 


3421 


-.41923 


03170 




. «2623 


. 09547 


. 0/726 


.13651 


0422 


-.03664 


.08052 




. 02652 


.01293 


-.15264 


- . 07959 



7RAN3F0RHATI0il MATRIX 



FACTOR t FACTOR 2 



FACTOR 
FACTOR 
FACTOR 
FACTOR 
FACTOR 
FACTOR 



3 
4 
5 
6 



.77337 
-.37236 
. I 0914 
.44732 
-.22047 
-.^4812 



.46203 
.81902 
-.24573 
-.01488 
.034(6 
.23231 



FACTOR 3 

- 36416 

. 3737 J 
. t9067 
.7t631 
-.29456 
-.30248 



FACTOR 4 

.06460 
. t53t0 
.9230t 
-.13130 
.09733 
.29065 



FACTOR 3 

-.20529 
-. 1634 0 
-. t6336 

.45703 
22508 

.30t94 



FACTOR 6 

.09748 
. 02438 
.04 050 
.24554 
.89629 
-.35303 
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Table 16 B 
Part 2 

Section 4 

VARIHAX ROTATED FACTOR tt*TR:;< 

at the institution level 



FACTOR 1 FACTOR 2 FACTOR 3 FACTOR 4 FACTOR 5 FACTOR 6 



3401 
34 02 
$4 03 
34 04 
S4 05 
S4 06 
S4 07 
S4 08 
34 A9 
S410 
S41 1 
S4 12 
S4I3 
S414 
34 IS 
8414 
S417 
S418 
3419 
S420 
$421 
3422 



.31810 
- . 0323$ 
-.06757 
-.20960 
-.21 174 
- . 3483* 
-.30537 
. 3396* 
. 14710 
.425t4 
-.61972 
.23038 
.43337 
-.00839 
- . 76 1 J* 
-.01679 
.46267 
-.70*22 
-.5*191 
.72170 
.50730 
.14519 



. 03554 
.045 00 
.324 00 
.89003 
. 66258 
.71991 
.38736 
-.23615 
. 04021 
-. 12555 
. 16502 
-.121 10 
-.18592 
-.12554 
.11751 
. 03304 
-. 16264 
. 22256 
. 17043 
- . 1 0598 
-.06312 
. 17824 



. 02921: 
,03305 
-.03303 
-. 1 1400 
- . 09469 
-.18570 
-.10141 
.18859 
-.01423 
. 25934 
- . 0329* 
.74202 
.47710 
.,;'6092 
-.204 93 
.0321 1 
.50242 
-.32051 
-.12298 
•48999 
.1821<* 
-.0302? 



.20276 
- . 05826 
. 18226 
-.09421 
- . 3644 1 
-.30504 
-.47633 
. 19461 
.29750 
. 33224 
. 03539 
.12101 
. 13634 
.61404 
-.00335 
.10187 
. 05265 
-.26140 
-.27800 
. 1 1390 
. 07355 
-.22*51 



.299*3 
.88675 
.01663 
. 05939 
. 15326 
. 09684 
.09!?i 
.39419 
.07189 
. 15220 
.0173/ 
.06075 
. 1 1843 
. 19965 
. 04702 
. 01719 
.02237 
. 0*54 1 
. 09738 
. 00876 
. 08948 
. 00172 



-.30358 
. 00634 

- . 03495 

-.04631 
.10714 
. 05333 

-.17304 

-. 06484 

-.02944 
. 19574 
. 05234 
. 1 1 254 

-.00730 
.05259 
. 03 1 65 
.86*36 

-.04330 
.07722 
. 1 0330 

- . 06679 
.34213 

-. 11 930 



TRANSFORMATION MATRIX 



FACTOR 
FACTOR 
FACTOR 
FACTOR 
FACTOR 
FACTOR 



FACTOR 1 FACTOR 2 FACTOR 3 FACTOR 4 FACTOR 5 FACTOR 6 



-.69518 
.49146 
-. 13761 
-.07846 
-.30024 
- . 39994 



.484 08 
77261 
.32500 
• 23949 
. 07434 
. 01304 



-.41296 

.23971 
.15494 
. 1 335* 
. 1 144U 
.84600 



.31526 
. 1 03*6 
. 4 1 395 
. 1491 1 

.73530 
.2821 0 



. 1 1 087 
.29946 
.44332 
.72023 
. 4 1 026 
.12270 



-.01345 
-.06527 
.69^38 
.61^45 
'32581 
-.17184 
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Table 17 A 



Part 1 



Section 6 

correlation cocff icin«rs . at the respondent level 



8601 

8602 

$603 

56 CM 

S605 

$606 

860? 

8608 

8609 

8610 

861 1 

8632 

8613 

8614 



I 

I 



8601 

5602 

8601 

8604 

8603 

8606 

8607 

8608 

8609 

8610 

8611 

8612 

8613 

8614 



9601 


S6 02 


8603 


1 .00000 


.36604 


. 14931 


.36604 


1 .00000 


.20373 


1 -J AK 1 

. 14951 


. 20373 


t . 00000 


-.10381 


- . 08732 


-.12136 


- . 09804 


- . 0S463 


-.07536 




. 16975 


. 1 1 309 


. 1 1912 


. 12477 


. 13923 


.07224 


. 05881 


. 03673 


.30896 


.26121 


.1438* 


. t 0890 


. 14194 


. 16083 


. 06342 


. 08203 


. 1 030* 


. 1 3939 


. 1 1269 


.11051 


. 06687 


. 0274 1 


. 07724 


. 1 0034 


.08802 


.04710 


861 1 


8612 


86?3 



S604 

- . 1 038 1 
- . 08752 
-.12156 
1 . 00000 
.270'*0 
-.26330 
-. 16398 
-. 1 1733 
-.21253 
-. 19060 
-.01091 
19534 
-.171 13 
-.13356 



8614 



. 06342 


. 13939 


. 06687 


. 1 0084 


. 08203 


. 1 1 269 


.02/41 


.06802 


.10309 


. 1 1051 


. 07724 


.04710 


-.01091 


-. 19554 


-.171 15 


-.13556 


-.064 00 


-.21371 


-.15896 


-.22230 


. 1 1304 


.27441 


.20592 


.27147 


.13639 


.30266 


.22366 


.23000 


. 09333 


.29172 


.24232 


.26518 


. 1 3987 


.28724 


. 164 08 


.25461 


. 13501 


.38053 


.23652 


.38361 


f .00000 


. 15234 


. 05732 


.06766 


. 13234 


1 .00000 


.36429 


41674 


* 05732 


. J6<29 


1 .00000 


.33953 


.06766 


.41674 


.3395.4 


1 .00000 



8605 

- . 09854 
-.08463 
-. 0758* 
.27090 
1 . 00000 
-.63226 
-.21637 
-.16755 
-.34018 
-.23230 
-.06400 
-.21371 
-.15896 
-.22230 



$606 

. 14644 
. 16975 
. 1 1309 
-.26330 
-.63226 
1 .00000 
. 29628 
.21415 
. 45654 
.27870 
.11304 
.27441 
.20392 
.27147 



S607 



. 1 1912 
. 12477 
. 1 5*25 
. 1 6393 
.2'637 
.29623 
. 00000 
.29467 
.23731 
.34300 
. 15659 
.30166 
.22366 
.25000 



I 



5603 

. 07224 
.05381 
.03673 
-.11 733 
-.16755 
.214.13 
.2*467 
1 .00000 
.16644 
.30531 
. 09353 
.29172 
.24232 
.23313 



$60? 

30396 
.26121 
. M388 
-.21233 
-.34018 
.45854 
.28731 
. 16644 
1 . 000O0 
. 23536 
. 1 3*37 
. 28724 
. 16403 
. 2546 1 



?6I0 

. 1 0390 
. 14194 
• 16033 
- . 1*060 
-.23250 
.27370 
.34500 
.30531 
.23388 
1 . 00000 
. 15501 
.38053 
. 23352 
.33361 
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Table 17 A 



Section 6 Part 2 



CfJMKELAT 1 ON 


r qpff if ipu rs 

V wC r r A *» 1 til 1 v 1 


at the 


in^tif'iif'i nn 


J.t5 VtS J. 














/ t 

! 


S60I 


S6 02 


S603 


S604 


ODUJ 


Crf. ft* 


Ci ft"? 




S609 


361 0 


r S401 1 


1 , 00000 


.47688 


. 1 9935 


- t 0527/ 


. u>> 1 




. 1 4 J . 


. 03158 


.44033 


. 1 1 036 


8402 


• 47689 


1 , 00000 


• 32362 


— 1 did 4 


• 1 «fo6o 




• 1 4 «5*b 


-. 02042 


. 3*524 


. 06/47 


fit 03 


. 19935 


32362 


t 00000 


.1 y ^ 4 1 


— . 1 427 J 


• 20/76 


. 23031 


. 05942 


. «/ *L 0 *i 7 


.23131 


• 8604 


mm t 05277 


"1 1 4304 


. 1 7"t »> 1 


1 ft ft ti ft A 


*1 A tide* 


—.41616 


- .2/5 1 7 


-. 1 2120 


-.37573 


- . i 2294 


1 ~« 


• 03 f 

■ V<9 1 J™ 


. 1 cDDP 




4 ft ftOO 

. * UO97 


t A ft c» ft ft 


-.81 355 


- . 33033 


-. K515 


-.50306 


-.22a 79 




• 1 a, 74«9 




. 2 u/76 


—.41616 


- . 81 355 


1 . OuuOO 


. 4 05 *9 


. 1 89 1 2 


. 64638 


.215*1 


' 8607 1 


. 14539 


.14366 


.250 


-.27517 


-.33063 


. 4 0599 


1 .00000 


. 31 4 03 






8606 


. 08 1 58 


-.02042 


. 059 » 


12120 


-.14515 


. I89'2 


.31403 


1 . 0U000 


. 1 5332 


. 36290 


* 8609 ;. 


.44036 


. 36524 


.2252/ 


-.3/573 


-.50306 


.64688 


. 4 0*33 


. 15332 


1 . 00000 


.23746 


8610 


. 1 1 086 


,06747 


.23131 


- . 1 2294 


-.22579 


.21561 


. 36254 


.36290 


.23/46 


1 . OOOuO 


8611 


.17539 


.21316 


.27019 


-.05590 


-.21879 


.2*159 


.351 03 


. 15433 


.21960 


. 22731 


8612 


.210/0 


. 09462 


. 22233 


- . 1 059 1 


-. 19134 


. 225 1 0 


.40647 


.37t-44 


.32504 


.3303/ 


8613 • 


. 07427 


-.04491 


.0/53/ 


-. 14207 


-. 18054 


.25291 


.23246 


. 4 1 057 


.20224 


.21659 


8614 • 


. 06242 


. 00672 


.1359/ 


-.12597 


-. 19391 


.23*05 


.2382/ 


.37194 


.1351 0 


.40612 



I 

o 





861 1 


S6I2 


8613 


S614 


8601 


. 17589 


.21070 


.0742/ 


. 06242 


8602 


.21316 


. 09462 


-.04491 


. 00672 


8603 


.27019 


.22233 


. 0/537 


. 1 3597 


8604 


-.05590 


-.1 0591 


-. M207 


-. 12597 


8605 


-.21879 


19134 


-.18054 


- . 1 939 1 


8606 


.29159 


.22510 


.25291 


.23905 


8607 


.35103 


.4 0647 


.23246 


.28327 


8608 


. 1543ft 


.37544 


.41057 


.3/194 


$6 09 


.21960 


.32504 


.20224 


. 13510 


8610 


.22731 


.33037 


.21659 


.4 0612 


8611 


t .00000 


.2^021 


. 0/517 


. 09293 


8612 


.25021 


1 . 0 1000 


.461 /6 


.43320 


8613 


.0/517 


.46178 


1 .00000 


.45281 


8614 


. 09293 


.43820 


.45231 


1 .00000 
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Table 17 B 



Section 6 Part 1 

VARIMAX ROTATED FACTOR MATRIX 

at the respondent level 





FACTOR 1 


FACTOR 2 


FACTOR 3 


FACTOR 4 


8C01 


. 0792/ 


.07831 


.61960 


. 03420 


8602 


. 01744 


. 07328 


.5684 0 


. 15099 


8603 


. 0J879 


.05409 


.24 03& 


.2526? 


8604 


- , 1 9994 


-.27960 


- . t 093fc 


-.07738 


8605 


-. 15309 


-.74540 


-.0320t 


-. 06615 


8606 


. 19374 


.78799 


. 12780 


. 16193 


86 0? 


.32199 


. 1902? 


.08768 


.44773 


t608 


.4 0954 


. 1 1 559 


.0004$ 


.234 00 


8609 


. 2263* 


.40041 


. 3775* 


.20484 


S610 


.46412 


.16531 


. 09924 


.37194 


861 1 


. 0801ft 


.04131 


. 07682 


.28305 


8612 


.60554 


.14274 


. 12323 


. 16620 


8613 


.51649 


.1 1242 


.02170 


. 051 19 


8614 


. 62652 


.16119 


.07384 


. 05704 



TRANSFORM AT I OH MATRIX 



FACTOR I FACTOR 2 



FACTOR 



FACTOR 4 



FACTOR 1 

FACTOR 2 

FACTOR 3 

FACTOR 4 



.63850 
.67212 
.11254 
•.357*3 



.5864? 
-.4645*: 
-.66264 
-.03445 



.3280? 
-.57083 

.70432 
-.26543 



.37514 
. 08143 
.22842 
.89469 



Part 2 

Section 6 

VARIMAX ROTATED FACTOR WATRIX 

at the institution level 





FACTOR 1 


FACTOR 2 


FACTOR 3 


FACTOR 4 


S*01 


. 0225? 


.10216 


.77 036 


. 09764 


86 02 


. 1 3594 


-.10212 


58854 


.28213 


03 


. 1 0648 


. 07875 


.2261* 


.46334 


SA04 


-.4485? 


- . 09629 


-.0?35£ 


-.1 139? 


8605 


-.82957 


1 1843 


. 03 1 1 6 


-. 14779 


S606 


.91631 


, 15836 


.10177 


. 16973 


S6 07 


.304 04 


.35601 


. 07772 


.47260 


8603 


. 08203 


.57253 


-.01855 


.13031 


S60* 


.5909* 


.20175 


.4*465 


. 15452 


seio 


.10824 


.4514* 


. 01273 


.37496 


861 1 


. 15080 


. 1 09>C 


. 12441 


.48298 


8612 


. 08233 


.66324 


.16046 


.25313 


86 13 


.15213 


.66294 


. 02676 


-.07543 


8614 


. 1 1078 


.66 066 


-.00909 


. 1 1031 



TRANSFORMATION MATRIX 



FACTOR ! FACTOR 2 FACTOR 3 FACTOR 4 



FACTOR 1 

FACTOR 2 

FACTOR 3 

FACTOR 4 




.64610 
.46996 
-.58724 
12976 



.56242 
.78571 
.04620 
-.25339 
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.30938 
-.40097 

.75374 
-.41889 
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.41282 
.03456 
.2913? 
,86226 



D Market A market culture implies that the institution is 

production-oriented and values the accomplishment 
of tasks. Goals drive the institution's 
activities, and there is a sense of competition 
and achievement among members. The leader is 
usually a hard-driving producer who places high 
priority on results. 

Some institutions have a single dominant culture while others 

# 

have a more heterogeneous culture. This section of the 
questionnaire asesses both the types of cultures which exist in 
the institution, and t! extent to which a given culture 
predominates. If the questions in this section are well 
constructed, the correlations between questions assessing the same 
type of culture should be more highly correlated than questions 
measuring different cultures. In other words, respondents who 
rated a particular item (e.g., leadership) as being highly clan- 
like, are also expected to rate other items (e.g., cohesion, 
institutional emphasis) as being highly clan-like. 

Table 18 displays the inter-question correlation matrices for 
each culture type at both the respondent and institution level, 
and the coefficient alphas calculated at the institution level. 
The data in this table indicate that the correlations within 
culture types were generally higher than correlations between 
culture types. For example, the correlation between question 1- 
item A and question 2-item A is .18 at the respondent level. This 
correlation is higher than the correlations between question 1- 
item A and question 2-item B, question 1-item A and question 2- 
item C, and question 1-item A and question 2-item D. 
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Table 18 

Section 5: Correlation Matrices for Each Culture Type 
Respondent Level (n=3,002) 
Institution Level in parentheses (n=334) 



Item k: Clan Culture (alpha= .82) 

Q# 1 2 3 4 

1 1.00 

2 .18 (.30) 1.00 

3 .59 (.76) .19 (.31) 1.00 

4 .55 (.78) .18 (.38) .47 (.66) 1.00 



Item B: Emergent System (alpha= .83) 

Q# 1 2 3 4 

1 1.00 

2 .37 (.48) 1.00 

3 .52 (.76) .36 t . 55) 1.00 

4 .32 (.50) .32 (.57) .41 (.60) 1.00 



Item C: Hierarchy Culture (alpha= .67) 

Q# 1 2 3 4 

1 1.00 

2 .043 (.07 b ) 1.00 

3 .60 (.76) .09 (.13 c ) 1.00 

4 .36 (.41) .13 (.38) .37 (.42) 1.00 

Item D: Market Culture (alpha= .78) 



Q# 


1 




2 




3 


1 


1.00 










2 


.29 ( 


.40) 


1.00 






3 


.43 ( 


.62) 


.22 ( 


.34) 


1.00 


4 


.37 ( 


.57) 


.27 ( 


.44) 


.39 ( 



3) 1.00 

Question 1= Institutional Characteristics 
2 = Institutional Leadership 
3= Institutional Cohesion 
4= Institutional Emphases 

a The correlation between Ql-item C and Q2-item C was .04 
but the correlation between Ql-item C and Q2-item D was 
.15. 

b The correlation between Ql-item C and Q2-item C was .07 
but the correlation between Ql-item C and Q2-item D was 
.25. 

c The correlation between w2-item C and Q3-item C was .13 
but the correlation between Q2-item C and Q3-item A was 
.20. 

ERIC -"- 9 8 



m The data in Table 18 indicate that there were only three 

exceptions to this trend — all of which occured in the Hierprchy 

■ Culture matrix, T*e institutional characteristics hierarchy item 
had a nigher correlation with the institutional leader market item 

| than with the institutional leader hierarchy item, 

m Another means of examining the construct validity of the 

items in Section 5 is through their correlations with other items 

■ in the instrument. However, a correlation matrix of the sixteen 
items in Section 5 with other questions would result in an 

| unwieldy matrix of numbers. To obviate this problem four new 

_ variables were created. Each of these variables was the average 

■ number of points allocated per culture item across questions. For 

■ example, the new average clan variable was Ql-item A + Q2-item A + 
Q3-item A + Q4-item A divided by four. Each of these four new 

I variables contained 0 to 100 points. This strategy seemed 

reasonable in view of 1) the relatively high degree of internal 

■ consistency as reflected in estimated coefficient alphas, and 2) 

■ the parsimony such a strategy r^ovides. 

The four summary variables were correlated with selected 

■ questions in the other sections of the questionnaire at both the 
respondent and institution level. The results are presented in 

■ Table 19. The magnitude and pattern of correlations reported in 

■ this table conform to our expectations of how various aspects of 
institutional performance should be related to particular cultural 

I emphases. 

For example, the data in Table 19 indicate the higher the 

■ score on the Clan variable, the higher the score on question* 

| -74- 
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Table 19 

Section 5: Correlations of Summary Culture Variables with 
Selected Questionnaire Items 

Respondent Level (n=3 r 002) 
Institution Level in parentheses (n=333) 



Section & Question 

Section 4 

1 Specialization 

2 Formalization 

6 Mission 

7 Invtr .Confidence 

8 Struct .Coupling 

9 Centralization 

10 Planning 

11 Innovation 

12 Scapegoating 

13 Resist. to Change 

14 Admin. Turnover 

15 Morale 

16 Slack Resources 

17 Interest Groups 

18 Adm. Credibility 

19 Reall .Priorities 

20 Conflict 

21 Locus of Control 

22 Int. Mobility 

Section 6 

4 Conservatism 
7*Conservatism 

5 Moderate Change 

8 Moderate Change 

6 Innovation 

9 Innovation 

Section 8 

26*St/Fac Relations 

27*Equity 

28*Org. Health 

29 Trust 

30 No Conflict 
31*Rewards 
32*Feedback 



Clan Emergent 



1 1 

• • 12 


/ O ft \ 

(- . 20 ) 


- .05 


( .01) 


•.05 


(-.14) 


-.05 


(-.22) 


• 28 


/ A £ \ 

( • 46 ) 


. 11 


(- . 01 ) 


.17 


( .29) 


.14 


( .05) 


• 11 


(- . lo ) 


- .09 


/ ft o \ 

( • 08 ) 


• 11 


(-.19) 


- • 10 


/ ft ~s \ 

\ .03) 


fi K 


(- . 09 J 


- . 19 


(-.11) 


ft o 
• Oo 


( • 05 ) 


• 32 


\ • 36 ) 


• ut> 


(- . 20 ) 


ft c 

- . 06 


(-.11) 


.07 


(-.12) 


-.28 


(-.41) 


1 ft 
• 1U 


(-.11) 


ft 4 

- . 01 


( .11) 


.13 


( .15) 


.25 


( .23) 


nn 


I • 02 ) 


ft A 

.04 


/ ft "7 \ 

( . 07 ) 


• Id 


/ ii\ 
(— • 5 5 ) 


ft o 

- • Oo 


/ ft C \ 

(-• 05) 


• 1 / 


( .21) 


• 23 


( • 22 ) 


n "7 


\ • Oo ; 


• 21 


( • 21 ) 


• lb 


(-.21) 


- • 20 


(- • 18 ) 


• 10 


(-.19) 


- . 18 


(- • 20) 


fi c 


\ . Oo ) 


- . 01 


/ ft A \ 

( • 04 ) 


.00 


( .20) 


-.21 


(-.37) 


.06 


( .06) 


-.23 


(-.38) 


.01 


( .21) 


-.38 


(-.61) 


.08 


( .13) 


.15 


( .11) 


.06 


(-.26) 


.48 


( .73) 


.01 


(-.14) 


.36 


( .56) 


.40 


( .63) 


.03 


(-.14) 


.19 


( .34) 


.16 


( .04) 


.14 


( .19) 


.18 


( .07) 


.22 


( .33) 


.17 


( .13) 


.22 


( .29) 


.15 


( .15) 


.10 


( .09) 


.18 


( .09) 


.13 


( .16) 


.17 


( .06) 



Hierarchy Market 



• 14 


( .23) 


.06 


( .06) 


.16 


( .42) 


-.06 


( .02) 


-.17 


(-.36) 


-.12 


(-.38) 


-.20 


(-.26) 


-.17 


(-.26) 


• 11 


( .07) 


. 11 


( .14) 


• 11 


( .00) 


. 14 


( .28) 


. 17 


( .18) 


. 09 


( .08) 


-.29 


(-.39) 


-.12 


(-.08) 


.07 


( .24) 


. 07 


( .21) 


.27 


( .52) 


.08 


( .11) 


• 02 


(-.08) 


. 13 


( .15) 


-.25 


(-.32) 


-.16 


(-.18) 


ft A 

- • 04 


(-.05) 


.01 


(-.00) 


• 16 


( .33) 


. 12 


( .24) 


- • 25 


(-.36) 


-.20 


(-.22) 


O ft 

-. 20 


(-.27) 


-.10 


(-.05) 


• 23 


( .34) 


. 19 


( .21) 


• 21 


( .35) 


.09 


( .16) 


.00 


/ ft ^ \ 
(- . 03 ) 


-.06 


(-.13) 


.16 


( .22) 


.04 


(-.16) 


.22 


( .35) 


.07 


(-.03) 


.29 


( .41) 


.05 


(-.08) 


-.17 


(-.25) 


-.08 


(-.08) 


-.34 


(-.46) 


-.05 


( .08) 


-.28 


(-.41) 


-.06 


( .03) 


.21 


(-.37) 


.29 


(-.50) 


-.19 


(-.30) 


-.22 


(-.30) 


-.18 


(-.19) 


-.18 


(-.19) 


-.21 


(-.33) 


-.24 


(-.35) 


-.22 


(-.34) 


-.23 


(-.29) 


-.17 


(-.15) 


-.15 


(-.08) 


-.18 


(-.17) 


-.15 


(-.17) 



*Scale was reversed 



r ® 
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Table 19 
(continue 1) 



Section 5: Correlations of Summary Culture Variables with 
Selected Questionnaire Items 

Respondent Level (n=3,002) 
Institution Level in parentheses (n=333) 



Section & Question 



Clan 



Emergent 



Hierarchy 



Market 



Section 7 

1 Bureaucratic 

7 Bureaucratic 

2 Autocratic 

8 Autocratic 

3 Collegial 

9 Collegial 

4 Rational 

10 Rational 

5 Org. Anarchy 

11 Org. Anarchy 

6 Political 

12 Political 

Section 8 

1 St. Ed. Satis 

2 St.Acad.Dev 

3 St. Career Dev 

4 St. Personal Dev 

5 Fac/Admin. Satis 

6 Dev. of Faculty 

7 System Openness 

8 Ability Acq. Res 

9 Org. Health 



.05 


( .05) 


-.01 


(-.18) 


.01 


( .20) 


-.07 


(-.08) 


.14 


(-.18) 


-.23 


(-.31) 


.29 


( .45) 


.12 


( .18) 


.15 


(-.17) 


-.11 


( .00) 


.12 


( .04) 


.18 


( .25) 


.16 


(-.23) 


-.13 


( .04) 


.14 


( .03) 


.21 


( .31) 


.17 


( .26) 


.14 


( .01) 


-.16 


(-.13) 


-.21 


(-.31) 


.17 


( .27) 


.19 


( .09) 


-.22 


(-.24) 


-.19 


(-.30) 


.11 


( .12; 


.17 


( .06) 


-.16 


(-.12) 


-.16 


(-.15/ 


.14 


( .25) 


.21 


( .14) 


-.23 


(-.31) 


-.36 


(-.24) 


.06 


(-.02) 


-.12 


(-.00) 


.11 


(-.03) 


.09 


( .07) 


.06 


(-.10) 


-.15 


(-.08) 


.13 


( .15) 


.10 


( .09) 


.17 


(-.26) 


-.20 


(-.07) 


.24 


( .27) 


.18 


( .22) 


.04 


(-.12) 


.06 


( .16) 


-.05 


(-.08) 


.04 


( .10) 


.15 


( .18) 


.11 


( .04) 


-.16 


(-.16) 


-.15 


(-.18) 


.13 


( .14) 


.15 


( .13) 


-.20 


(-.20) 


-.12 


(-.18) 


.01 


(-.11) 


.11 


( .14) 


-.10 


(-.12) 


.02 


( .15) 


.34 


( .56) 


.00 


(-.22) 


-.19 


(-.19) 


-.26 


(-.49) 


.21 


( .28) 


.14 


( .01) 


-.20 


(-.17) 


-.22 


(-.30) 


.02 


(-.14) 


.19 


( .25) 


-.14 


(-.10) 


-.01 


( .05) 


.12 


( .16) 


.24 


( .20) 


-.25 


(-.28) 


-.13 


(-.19) 


.01 


(-.09) 


.22 


( .23) 


-.18 


(-.14) 


-.04 


( .03) 


.27 


( .42) 


.19 


( .07) 


-.27 


(-.35) 


-.28 


(-.40) 
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pertaining to mission, student-faculty relations, organizational 
health, and trust. Conversely, the higher the Clan score, the 
lower the score on questions pertaining to autocratic decision 
style, the role of interest groups, and perceptions of conflict. 

Similarly, the higher the Hierarchy score, the higher the 
score on questions pertaining to specialization, formalization, 
bureacratic decision style, and conservatism. Conversely, the 
higher the Hierarchy score, the lower the score on questions 
pertaining to innovation, trust, conflict, and collegiality . 
These results lend support to the construct validity of the 
questions contained in Section 5. 

A related means of assessing the construct validity of the 
items included in Section 5 entails examination of the 
relationship between the culture scores. This was done by 
calculating the correlations between the items included in each of 
the four questions. The results of this analysis are reported in 
Table 20 ■ 

The results are somewhat ambiguous. Clan items are always 
negatively correlated with each of the other culture items. The 
hierarchy and market items in the general institutional culture 
question have a small positive correlation. Otherwise, the 
emergent system, hierarchy and market items are negatively 
correlated or uncorrelated in all questions. This suggests that 
when respondents allocated points to the clan items, they 
allocated a large proportion of points. However, when respondents 
allocated points to the other culture items, the points tended to 
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Table 20 

Section 5: Correlation Matrices for each Question 
Respondent Level (n=3,002) 



Question 1: General Institutional Culture 



Clan 

Emergent 

Hierarchy 

Market 



Clan 
1.00 
-.19 
-.61 
- .66 



Emergent Hierarchy Market 



1.00 
-.40 
-.17 



1.00 
.15 



1.0 



Question 2: Institutional Leadership 

Emergent Hierarchy 



Clan 
Emergent 
Hierarchy 
Market 



Clan 
1.00 
-.27 
-.43 
-.31 



1.00 
-.44 
-.16 



1.00 
-.35 



Market 



1.0 



Question 3: Institutional Cohesion 



Clan 

Emergent 

Hierarchy 

Market 



Clan 
1.00 
-.40 
-.47 
-.60 



Emergent Hierarchy Market 



1.00 
-.28 
-.06 



1.00 
-.06 



1.0 



Question 4: Institutional Emphases 



Clan 

Emergent 

Hierarchy 

Market 



Clan 
1.00 
-.38 
-.36 
-.50 



Emergent Hierarchy Market 



1.00 
-.44 
.02 



1.00 
-.29 



1.0 
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■ be more spread out. Table 21 displays the means and standard 
deviations for each of the culture items for each question, 

■ The questions in Section 7 are concerned with institutional 
flj decision processes. The section is comprised of six pairs of 

items dealing with the type of decision process used at the 

■ institution for allocation of resources. One item from each pair 
explicitly asks whether resource allocation is decided in a 

| certain manner (e.g., bureaucratically ) • The other item 

_ paraphrases the question (e.g., this institution has a standard 

■ set of procedures). 

■ If the items in Section 7 are well constructed then we should 
find that 1) each member of a pair correlates more highly with its 

J match than with any other item in this section; and 2) that each 

member of a pair correlates negatively with its theoretical 

■ antithesis — e.g., autocratic vs. collegial decisionmaking. The 

H correlations between all items in this section were calculated at 

the respondent and institution level. The results of these 

■ analyses are reported in Table 22A and 22B, respectively. The 
correlations between theoretically matched items were extracted 

I from this table and are summarized in Table 23. 

m The results reported in Table 22A and 22B indicate that items 

in four of the six pairs correlate more highly with each other 

■ than with any other item. The items measuring bureacratic and 
political decisionmaking correlate more highly with other items 

| than with their matching item. As might be expected, the items 

tm found in the four highly intercorrelating pairs show strong 

■ negative correlations with their antithetical counterparts. For 

I -79- 
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Table 21 



Section 5: Means and Standard Deviations 
Respondent Level (n=3,203 to 3,248) 

Clan Emergent Hierarchy Market 

Question Mean SD Mean SD Mean SD Mean SD 

1 General Culture 50.8 26.7 18.5 16.1 17.1 20.3 13.6 17.4 

2 Leadership 17.1 24.3 21.3 22.1 44.6 27.6 17.0 20.7 

3 Cohesion 46.2 27.0 16.7 17,4 16.5 18.9 20.7 18.4 

4 Emphases 33.9 23.6 22.8 18.3 25.1 21.8 18.2 17.9 
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Table 22 A 



Section 7 

correlation coefficients, at the respondent level 



•71 

•72 

•73 

•74 

•75 

•706 

•707 

•/08 

•709 

•710 

•71 1 

•712 



S7I 

I .00000 
-.31031 
.35813 
.46630 
-.47550 
-.34360 
-11227 
-.35299 
.33812 
.34436 
-.30545 
-.00166 



672 

-.31031 
I .00000 
-.59016 
-.49027 
.36216 
.41369 
.22390 
.60589 
-.52074 
-.40266 
.34748 
-.11520 



S73 

.35813 
-.59016 
1 , 00000 

.54436 
-.38331 
-.44792 
-.28647 
-.56521 

,6435* 

.46739 
-.34303 

. 1226? 



S74 

.46630 
-.49027 

.54436 
1 .00000 
-.57393 
-.56831 
-.27682 
-.57629 

.56404 

.66633 
-.52079 

. 05687 



S75 

-.47550 
.36216 
-.33331 
-.57393 
1 .00000 
. 44826 
.2563/ 
.41808 
-.38512 
-.41361 
.45/44 
-00270 



S706 

-.34360 
.41369 
- . 44792 
-.56881 
.44326 
1 . 00000 
. 4*86 1 
.53296 
- . 46452 
- . 57598 
. 4»545 
. 1 09 1 6 



S707 

-. H227 
.22390 

-.23647 

- . 27632 
.25637 
.42361 

1 .00000 
.28715 

-.33403 

-.29068 
.27539 

-.00425 



S708 

-.35299 
.60539 
-.56521 
-.57629 
.41303 
.53296 
.23715 
1 . 00000 
- . 59458 
-.51321 
.43001 
-.09056 



>709 

.33812 
-.52074 

.64358 

.564 04 
-.33512 
-.48452 
-.33403 
-.59453 
I . 00000 

.51780 
-.36064 

. 13735 



S710 

. 34436 
-.40266 

.46739 

.t *33 
-.41361 
- . 57593 
- .29063 
-.51321 

.5173U 
1 . 00000 
-.51333 

. 0041 0 



I 

00 



•71 

•72 
•73 

• 74 
•75 

• 706 
•707 
•708 
•709 
•710 
•711 
•712 



37 1 1 

-.30545 
.34748 
-.34303 
-.52079 
.45744 
.46545 
.27539 
.43001 
-.36064 
-.51338 
I .00000 
.06086 



•712 



.80166 

.11520 
.12263 
.05687 
. 00270 
.10916 
.00425 
,09056 
, 13735 
,00410 
06086 
00000 
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Table 22 B 



Section 7 

correlation coefficients . at the institution level 



i 

oo 
I 



8701 
$702 
S703 
8704 
S705 
$706 
S707 
S703 
S709 
S7t0 
5711 
8712 



$701 


S7 02 


S7 07 


S704 


S705 


S7C6 


1 . 00000 


- . 38297 


• 4 1 939 


. 4801 0 


«> ^AAdL« 


- , 274 * 


-.38297 " 


1 . 00000 


-.72197 


-.44601 


.38169 


1083 i 


.41939 


-.72197 


1 . 00000 


.53624 


-.43436 


m r 


. 4901 0 


— • 446 0 1 




1 A A A A A 
1 . I'll 00 0 


- .649? 2 


— . f *7 


-.3806'.* 


.38169 


-.13436 


-.64912 


1 . 00000 


« i* 9 


-.274 03 


. .30839 


-.43147 


-.65663 


.48619 


1 . 


-. 0377 J 


.20263 


-.34432 


-.40401 


.37123 


-.4707? 


.70930 


-.74234 


-.60609 


.51 061 




. 3869 J 


- . 62787 


.75177 


. 52922 


-.4373w 


4 


. 23322 


-.32360 


. 444 79 


.70870 


-.42324 


y 4 


- . 35889 


.323 09 


-.41721 


-.69346 


.34706 


.60732 


.^3194 


- . 1 88 1 0 


. 16359 


. 05498 


- . 05782 


. 14998 


S71 1 


S712 











S707 



S7D8 



. 03773 
.20263 
.34432 
.40401 
.37125 

. 00000 
.32463 
.40034 
.44541 
.41557 
.09903 



.47070 
.70930 
.74234 
.60609 
.51 06 1 
.43799 
"2468 
. t*>00 
. 31 5 
. 0V 
.4> ;> 
. I7r > 



S709 

.38693 
-.62787 

.75177 

. 32922 
-.43736 
-.46364 
-.4 0034 
-.731 15 
1 .00000 

.47318 
-.39305 

.20837 



S710 

. 23322 
-.32360 

.44479 

.70370 
-.42324 
-.68244 
-.44541 
-.47057 

.47<M8 
I . 00000 
- . 62394 
- . 03233 



S701 

S702 

S703 

S704 

$705 

$706 

$.'07 

S703 

S709 

$710 

8711 

87*2 



- . 33883 
.32509 
-.41721 
-.69346 
.54706 
.60732 
.41557 
.49112 
-.39303 
-.62394 
1 . 00000 
-.07036 



. 03194 
. 1881 0 
. 16858 
. 03498 
, 05782 
. 14999 
. 09903 
, 17040 
.20637 
, 03233 
, 07056 
. 00000 
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. 0U06332< 



. 633229 07E- 03 > 
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Table 23 

Section 7: Correlations of Matched Items 

Respondent Level (n=3354 to 3373) 
Institution Level (n=334) 



Correlation 

Type of Between Respondent Institution 
Decision Process Items Level Level 



Bureaucratic 


1 


& 


7 


-.11 


-.06 


Autocratic 


2 


r 
J 


8 


.60 


.71 


Collegial 


3 


& 


9 


.65 


.75 


Rational 


4 


& 


10 


.66 


.71 


Org .Anarchy 


5 


& 


11 


.40 


.55 


Political 


6 


& 


12 


.11 


.15 
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example, the correlation between the collegial decision item (#3) 
and the autocratic item (#8) is -.56, and -.74, at the respondent 
and institution level, respectively. 

The results of these analyses suggest that the items in four 
of the six pairs provide reasonably good information about the 
dimensions or constructs they are intended to measure. Th? 
results suggest that the items measuring bureacratic and political 
decisionmaking conditions are poor measures of their constructs. 

The items in Section 8: Performance and Actions of the 
Institution were extracted from Kim Cameron's effectiveness 
questionnaire (1978). These items operationalize the nine scales 
or dimensions as explained briefly below. 



Dimension 



Explanation 



Student 

Educational 

Satisfaction 

Student 

Academic 

Development 



The degree to which students are 
satisfied with their educational 
experiences at the institution. 

The degree of academic attainment, 
growth, and progress of students and 
the academic opportunities provided by 
the institution . 



Student 

Career 

Development 



Student 

Personal 

Development 



The degree of vocational and occupational 
development among students and the 
opportunities for career training provided 
by the institution. 

The degree of nonacademic, noncareer 
deve lopment (e.g., cultural , emoti ona 1 , 
and social) and the opportunities for and 
emphasis placed on personal development 
by the institution. 
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Faculty and 

Administrator 

Satisfaction 



The satisfaction of faculty members and 
administrators with their employment. 



6 



Professional 
Development and 
Quality of the 
Faculty 



The degree of professional attainment 
and development of the faculty and the 
emphasis and opportunities for 
professional development provided by 
the institution . 



7 



System Openness 
and Community 
Interaction 



The emphasis placed on interaction 
with, adaption to, and service for 
constituencies in the external 
environment . 



8 



Ability to 

Acquire 

Resources 



The ability of the institution to 
acquire resources such as good students 
and faculty and financial support. 



9 



Organizational 
Health 



The vitality and benevolence of the 
internal processes in the institution 
such as openness and trust, problem 
solving adequacy, shared information. 



The correlations between all items in Section 8 are reported 
at the respondent and institution level in Tables 24A and 24B, 
respectively. The correlations between items purported to measure 
the same scale are reported in Table 25 along with internal 
consistency estimates (coefficient alphas) for data analyzed at 
the respondent level. The alphas range from .59 to .85 and are 
consistent with the internal consistency measures reported in 
Cameron's work. 

To assess the validity of the scales, factor analyses at the 
respondent level (n=2966) and at the institution level (n=334) 
were performed. In both cases the type of respondent was ignored 
and a principal-factor solution with iteration was selected. The 
varimax rotated factor matrix (factor loadings) at the respondent 
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Table 24 A 



Section 8 

correlation cocfficients .at the respondent level 





3901 


S802 


S3 03 


S3 04 


S301 


1 .00000 


.31981 


.2123? 


. 13323 


S3 02 


.31931 


1 .00000 


.23157 


.21236 


S3 03 


.2129? 


.2815? 


1 . 00000 


.43169 


S3 04 


. 13325 


•21236 


.45169 


1 . 00000 


S303 


.29369 


.22650 


•2122/ 


. 22792 


S306 


.23373 


.23833 


.22150 


.22770 


S3 07 


. 24334 


. 19826 


. 14161 


. 14846 


S3 09 


.30269 


.2221 1 


. 19762 


. 1 1 767 


S809 


.32787 


.34354 


.231 12 


.13961 


S31 0 


.37830 


.27443 


.25909 


. 2 1 992 


S3. 


.21812 


.33613 


.20456 


. 1 8 1 92 


S3 12 


. 274 1 4 


. 16834 


.32612 


. 4 0797 


S813 


. 17774 


.11 152 


.23042 


.30590 


SCI 4 


.21262 


. 18850 


.24417 


.29921 


S813 


. 09494 


. 12673 


. 07546 


. 0834 1 


S816 


. 00132 


. 16209 


. 05373 


. 07294 


S3I7 


.02034 


. 12023 


. 00091 


.00977 


S818 


. 24 1 98 


.21700 


.23139 


.23603 


S819 


.21293 


.20273 


.20779 


.22293 


S320 


,23677 


.24374 


.23283 


.23453 


S321 


. 19083 


.26348 


.21353 


.204 73 


S822 


. 01030 


. 06073 


.20623 


.33393 


S82J 


. 19333 


.20931 


. 1 7693 


.26054 


S324 


. 0972 1 


. 15189 


.20994 


.30946 


S323 


. 17483 


. 4 3972 


.30250 


.34918 


S826 


.33969 


• 18997 


. 03492 


. 06263 


S327 


. 26597 


.26030 


.23439 


.23093 


S323 


.23333 


.35373 


.33350 


,27337 


S829 


.23190 


.23614 


.23277 


.22706 


S830 


. 2293* 


.25347 


.23051 


.24949 


S831 


. 17429 


. 28393 


.23930 


.23356 


S832 


. 22969 


.23541 


.24306 


.24430 



305 


S3 06 


S3 07 


S808 


S3 09 


S31 0 


.29369 


.23373 


.24^54 


.30269 


. 32737 


. 5 


.22650 


.23333 


. 1 9926 


. 222 1 1 


. 343^ 


. 27443 


.21227 


.22150 


.14161 


. 19762 


.231 12 


. 259 09 


.22792 


.22770 


. 14346 


. 1 1767 


. 1 596 1 


• €. 1 ▼ ~ m. 


. 00000 


.633^0 


.61612 


.22337 


, 24499 


« C i~ 1 #. u 


.63390 


1 .00000 


.63042 


.20607 


. 2 1 573 




.61612 


.63042 


1 . 00000 


. 17534 


.21910 


• 21 *56 


.22337 


.20607 


. 1 7534 


1 .0000 0 


.44967 


• 54699 


.24499 


.21573 


.21910 


.44967 


1 . 00000 


.4 0799 


.23120 


.25620 


.21956 
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. 4 0799 


1 . 0 0000 
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. 18441 


.16251 
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. 09614 
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.11635 
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. 13065 
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. 09663 


0051 1 
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.03231 


. 07949 


. 03099 


• 06339 
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.34627 


.31234 


.23574 


. 18169 


. 1 9334 


. 26 1 97 


.24966 


.22913 


.20481 


. 16152 


. 16033 


. 23427 


.36760 


.34 087 


.30363 


. 17329 


.24379 


.27234 


.26496 


.23786 


.23325 


. 15601 


. 19992 


.20712 


. 1 1 024 


. 16973 


.07387 


.01 172 


. 04327 


.07101 


. 1 7 1 26 


.22544 


. 17012 


. 1 1702 


. 19206 


. 1 8696 


. 14336 


.19206 


.13709 


. 07393 


. 1 1 2<*3 


. 12 763 


.23673 


. 23988 


. 13324 


. 14363 


. 15^31 


.22343 


.22002 


.20228 


.214<»9 


.29249 


.23161 


.30937 


.32154 


.23277 


. 23975 


. 16671 


.23444 


26237 


.39169 


.34917 


. 34 073 


. 22 1 38 


. 28573 


.28363 


.32338 


.28891 


.23672 


. 16300 


. 19450 


.23556 


.3*493 


. 2^736 


.30232 


. 1 732 1 


.20422 


.23366 


.24369 


.24335 


.20909 


. 13319 


.23542 


20632 


.31361 


.27442 


.26333 


. 18152 


. 24255 


, 24 1 09 
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Table 24 A 
(Continued) 
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.24903 
. 1 5599 
. 36C34 
.42476 
,37333 
.38372 
.33 054 
. 3*»'2u5 



$319 

. 2 1 293 
.20275 
.20779 
.22295 
24966 
.22913 
.20431 
. 1 4 1 52 
. *4033 
.23427 
. 1 1 039 
. 24953 
. 1 1 524 
. 17323 
. 09452 
. 03473 
. 09750 
.51272 
1 . OOOuO 
.4 0353 
.60120 
. 06 038 
.1751 t 
. 09975 
. 19074 
. 14523 
.29034 
. 35 032 
,30446 
.31306 
...'44 09 
.24t 1 * 



$320 

. 23477 
.24374 
. 23233 
.23453 
.34740 
. 34 037 
.30363 
. 1 7329 
.24379 
27234 
.20440 
. 33936 
.19320 
.23156 
.15773 
. 14535 
. 03929 
,61 123 
. 4 0353 
1 . 00000 
51650 
. 1 1423 
.25447 
. 18137 
. 26 u51 
.15719 
.39329 
.46593 
.43496 
.44995 
.34574 
.36462 
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I 

oo 

00 
I 



8661 

S3 02 
8**3 

sao4 

8883 
S8 06 
$807 
$806 
8809 
8810 
881 1 
8812 
8813 
8814 
8815 
8818 
8817 
8816 
8819 
8820 
8821 
8822 
8823 
8824 

8825 ; 

8826 i 

8827 i 

8828 1 

8829 , 

8830 ! 

8831 t 
8832 

! 



S82I 


S822 






Coo* 
9025 


3826 


3327 


$323 


3329 


S330 


. 1 9089 


» 01 050 




• U 7 f < 1 


. 1 r4oD 


. 38969 


.26597 


. 25356 


.23130 


. 22936 


* 26348 


. 06073 


. 2 095 1 


• 1 1 0 7 


1 107'< 
. 1 SffK. 


. 13987 


.26030 


. 35375 


. 256 1 4 


. 25847 


. 2 1 333 


/ 2 0623 


♦ I r OOv 


• «. U77^ 


"1 r. o«: ft 


. 03492 


.23459 


.33350 


. 23277 


.25051 


.20473 


. 33593 


• *. v V 


. O v J^O 




. 06263 


.23093 


. 27337 


.22706 


. 24949 


/ 26496 


• 1 1 024 


• 1 ( 14%' 


. f ^Joo 


• lib' j 


. 22 0 02 


. 32 1 54 


.39169 


. 32338 


.354*3 


.25786 


. 16973 


• J't*^ 


* 1 72 UO 


. Zo73d 


. 20228 


. 23277 


.34317 


.23391 


.29756 


. 2332*S 


. V r OO r 


1 7 ft 1 !> 


. 1 *f f U7 


. 18324 


.21499 


. 23975 


.34073 


.28672 t 


. 3 0232 


* I V 1 


.VI 1 r 4 


1 1 7 ftO 


. Or 3to 


• 1 436*^ 


. 29249 


. 16671 


.22133 


. I630U 


. 17321 


• 1 777* 


ft4fi?7 


• 1 72 06 


. 1 1 293 


. 1 5981 


.23161 


.25444 


.23573 


. 19450 


.20422 


i 4 Vl 1 4C 


A7 1 ft 1 


. 1 OD 7& 




. 22643 


. 30937 


.26237 


.23363 


. 2355b 


. 23366 


1 4 ( I ( I 1 


ftAI ft ft 


. 1520** 


. 1 1 385 


. 1 3351 


. 14860 


.20935 


.23*78 


. 17052 


.16617 




. 247 jo 


.316 7b 


. 26498 


. 4 06 1 3 


. 16833 


.25273 


.27631 


. 23735 


.24743 


. 1 M974 


. « *-b *4 


. «: l«7«f 7 


. 26995 


. 3092U 


. 1 1 750 


. 1 3342 


. 1 5627 


.13059 


. 1 3397 


.171 03 


^7^S 1 


. 2o2 1 J 


• 25167 


. 29925 


. 14832 


.20454 


.21 128 


.17936 


. 1 7691 




. Vt A.OW 


1 ft A Cm£. 


. 1 Or 04 


• 16347 


. 07457 


. 12232 


. 14396 


. 09i95 


. 1 u734 


. 1 3207 


» 07583 


1 O f f.O 

. 1 4L r UO 


1 AU * 

. 1 033 r 


.114 05 


* 00438 


. 1 1587 


. 1 0779 


. 07794 


. 03933 


. 1 I60i> 


— ( 00226 


. wo i 


ft*5 1 


ft-» 1JA 

. Of o47 


- . 0 04 0 1 


. 09 07 1 


. 0945 1 


. 06433 


. 07632 


. 33906 


. 1 OS 1 A 


. & U7J^ 


\ AA ft O 

. 1 44 Uo 


» 247 0J 


. 15599 


.36334 


.42476 


. 37388 


.33372 


. 601 20 


» 06088 


1 7^1 1 


* UT7r? 


• 1 7U/*# 


. 14523 


. 29 034 


. 35032 


.30446 


. 3 1 3 0b 


. 5 1 65 0 


. 1 1 423 

• V > ^4L «p 




* 1 O 1 Jf 


. 26031 


. 15719 


. 39329 


. 46593 


.43496 


. 44995 


1 00000 

1 . V V V V v 


. i v&oo 


. 1 7J77 


. 1 Zo42 


ft ^ 
* 2043b 


. 15335 


.31401 


.33570 


.34490 


.36337 


. 1 0263 


1 . 00000 


. 30835 


. 44477 




mm AO' "9 AH 

» V2243 


» 077,52 


• 1 091 1 


. 091 1 2 


. 03659 


. 19399 


.30333 


1 . 00000 


.46699 


.26500 


. 1 7985 


.22627 


, 22525 


.20344 


. 2 0326 


e ?2842 


.44477 


.48699 


1 . 00000 


.29643 


.09309 


.15107 


. 16818 


. 15309 


. 15737 


.20456 


.25730 


.26300 


.29643 


1 .00004 


.08016 


. 19541 


.24649 


.203*2 


.21533 


. 15335 


02245 


. 1 793S 


.09309 


.03016 


1 . 00000 


.23733 


.234 06 


. 19726 


. 19303 


.31401 


. 09932 


.22627 


.15107 


.19541 


.23733 


1 .00000 


.55159 


.44040 


.46336 


.38370 


. 1 091 t 


. 2252* 


.16818 


.24649 


.234 06 


.55)59 


1 . 00000 


.52360 


» 55222 


.34490 


.091 12 


.20844 


.15809 


.20352 


. 19726 


.44040 


.52360 


1 . 00000 


.63093 


.3683/ 


.08639 


.20326 


. 1 5737 


.21503 


• 190 00 


.46336 


.55222 


. 68093 


1 . 00000 


.25349 


. 1 4963 


.21 Ib2 


.17163 


.20520 


. 1 3597 


.430^6 


.47724 


. 3bb3u 


.36151 


. 23864 


. 12050 


.20939 


. 15391 


.20799 


.20501 


.48771 


.52399 


.401 04 


.33744 
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Table 24 A 
(Continued) 



S831 S832 



.174-2* .22968 

Sd02 .23394 .23541 

S3 03 .25930 .24304 

8804 .28356 .24450 

8805 .24869 .31361 
8806... .24335 .27442 
MO? .209«i<* .26333 
8808 .13319 .18152 
8309 .23542 .24255 
8810 .20682 .24109 
Wll .21074 .22833 
8812 .24166 .22661 
3*13 .16141 .14248 

8814 .21036 .21755 

8815 .03959 .11375 

8816 .09379 .11310 
8317 .04744 .05335 
8318 h , .33054 .32205 

| 8319 .24409 .24519 

00 8320 .34f?4 .36462 

* 8821 , . .25349 .28864 

8822 J .14965 .12050 

8323 • .21162 .20939 

8324 . .17163 .15391 
8825 .20520 .20799 

8326 .13597 .20501 

8327 .48056 .48771 

8328 1 .47724 .52899 

8329 .36680 .40104 

8330 .36151 .38744 

8331 1.00000 .51180 

8332 .51180 1.00000 
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Table 24 B 



Section 8 

correlation coefficients, at the institution level 



1 





S80I 


8802 


S803 


3304 


S805 0 


S3 05 


S807 


33 08 


S3 09 


331 0 


' MOI 


I , 00000 


.30337 


.21529 


. 01337 


.38947 


. 32449 


.27366 


.71349 


. 39632 


.30449 


0 $802 


.30337 


t . 00000 


.24192 


. 04757 


. 27799 


.23574 


.23921 


20421 


.37103 


. 254 1 9 


8603 


.21329 


.24192 


1 . 00000 


.56765 


.26665 


.34367 


. 1 9 1 65 


.24916 


. 19157 


.27050 


M04 


.01337 


. 04757 


.56765 


1 .00000 


. 16600 


. 32279 


. 1 0665 


.04154 


. 00143 


.13134 


\ $603 


. 38947 


.27799 


. 26665 


. 16600 


1 . 00000 


.74920 


.764 73 


. 29363 


. 3 1 522 


.35012 


" $606 


. 3244** 


. 23574 


.34867 


. 32279 


.74920 


1 . 00000 


. 72232 


.25143 


.20320 


.31233 


$807 ' 


. 27366 


.23921 


. 19165 


. 1 0665 


.764 73 


. 72282 


1 .00000 


. 2???^ 


.33509 


. 2*^ • 94 


$806 


. 7 1 349 


.20421 


.24016 


.04154 


. 29368 


.25148 


.27773 


1 . 0U000 


.53299 


.76 :4 


$809 


. 39632 


. 37 1 08 


. 19157 


, 00143 


.31522 


.20820 


.335u9 


.53299 


1 . 00000 


.J'..«76 


$8t0 


.80449 


.25419 


.27050 


.13134 


.35012 


.31233 


.23194 


• 76244 


.39176 


1 . UOOOu 


$81 t 


. 13560 


.31557 


. 1 0606 


. 04 1 72 


.26644 


. 12306 


.25187 


.24636 


.6 0634 


.16714 


$812 


. 29662 


. 13647 


.4 7263 


.54587 


. 3536 1 


.51367 


.24176 


. 1 9722 


. 07394 


.35920 


8813 


.2342 0 


- . 02883 


.36973 


.50710 


. 14537 


.27308 


.04271 


. 13947 


. 00150 


.30156 


1 $614 


• 26 1 74 


. 14664 


.36542 


.49161 


.23499 


.37167 


. 194 02 


. 1204 1 


. 1 0463 


.28374 


VO 8815 


. 05724 


.21 033 


. 1 0224 


. 09151 


.24530 


.27109 


.251 73 


. 02224 


. 1 0131 


. 04574 


® $818 


-. 14828 


. 191 18 


-.01 149 


. 06800 


.23192 


. 27924 


.26331 


-.21353 


00609 


-.19910 


Sol 7 


-. 05842 


. 18609 


- . 08263 


-. 05098 


. 1 1653 


. 13198 


. 131 07 


-.05133 


. 04205 


- . 03 1 25 


' $610 ., 


. 35393 


.23390 


.34133 


.33821 


.43308 


.45770 


.37854 


.27415 


. 1 656 1 


.3716* 


$619 


.42082 


.20148 


,30202 


.22647 


.33432 


. 38455 


.2761 1 


.31736 


. 1 7600 


.39904 


$820 


. 35586 


.25360 


.39661 


.34474 


.55347 


.51579 


.47633 


.27677 


.24449 


.34533 


' $821 


. 32692 


. 29854 


.29403 


.24428 


.39603 


. 37826 


.31599 


.25703 


.23623 


.32034 


$822 


-.17977 


-.11704 


,34020 


. 6494 0 


. 05778 


.24210 


.017*3 


-. 16634 


- . 1 3426 


-. 1 U930 


$323 


. 19150 


. 17148 


.27161 


.41504 


. 1 9562 


.35 045 


. 1357 a 


. 0t>009 


. 04953 


. 1 S590 


$824 


-.03641 


- . 02552 


.34147 


.63290 


. 16619 


.33442 


. 15395 


- . 03662 


- . 1 02 1 1 


. 02150 


$829 


. 18512 


. 001 14 


. 33525 


. 49793 


.32036 


.4 7234 


.24212 


.20790 


. 1 1599 


.23639 


$82$ 


.66265 


. 34422 


. 14464 


-.09014 


.45049 


. 36623 


. 33998 


.4571 1 


. 33246 


.56415 


' $627 


. 37669 


.27347 


,32630 


. 24898 


.43473 


.42902 


.33907 


.24*61 


.27151 


.35370 


$828 


.32742 


.35706 


. 4 1 253 


.29607 


.57344 


.43954 


.47097 


.24635 


.23306 


.32245 


$829 


.36081 


.34 002 


.35943 


.26736 


.4953f 


.4031 1 


.41 U57 


. 29uu3 


.28452 


. 34342 


$830 


. 35548 


.36075 


.33604 


.29095 


.54397 


.44033 


.43719 


.24363 


,23670 


.31 173 


$83 1 


. 1 8426 


. 1 9 1 74 


.33257 


.29190 


.35173 


.23446 


.25635 


. 13535 


.23328 


.24 067 


$832 


.28675 


. 27277 


.19147 


. 17914 


.4 065 3 


.32550 


.367u6 


. 2t>*32 


.2641 0 


.25707 
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Table 24 B 
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981 1 


$812 


S313 


$314 


S815 


$816 


5317 


S313 


S319 


S320 


$801 


.13760 


. 29682 


.23420 


.26174 


. 05724 


-.14328 


- . 05342 


. 353^3 


.42082 


. 35536 


S3 02 


.31357 


. 1 3647 


-. 0239 J? 


. '4664 


.21 033 


. 191 13 


. 13*09 


.23390 


.20143 


.25360 


S3 03 


• 1 0606 


.47263 


. 36973 


.36542 


. 1 0224 


-.01 149 


- . 03268 


.34133 


.30202 


.39661 


5804 


. 04 1 72 


.54537 


.5071 0 


.49131 


.09151 


. 06300 


-.05093 


.33321 


.22647 


. 34474 


fed 03 


.26644 


.35361 


.14537 


.28499 


.24530 


.23192 


11 653 


.43303 


.33432 


. 55347 


S806 


. 123 Ufa 


.51367 


.273i'3 


.37167 


.27109 


. 27924 


. 1 3 1 98 


.45770 


. J3455 


.51579 


S807 


•25137 


•24176 


. 04271 


. 1 94 02 


.25173 


.26331 


.13107 


. 37354 


.2761 1 


.47633 


S803 


.24636 


. 1 9722 


. 13947 


. 12041 


. 02224 


-.21353 


-.05133 


. 274 1 5 


.31733 


.27677 


$80? 


.60634 


. 07394 


. 00150 


. 1 0463 


.10131 


-.00609 


.04205 


. 16561 


. 17600 


.24449 


$810 


.16714 


.35920 


.30156 


.23374 


. 04574 


-. 1991 0 


-.031 25 


.37166 


.39904 


. 34593 


$811 


1 .00000 


02931 


-.03700 


. 01334 


. 0618* 


- . 00073 


. 01454 


.06553 


. 02G03 


. 13151 


$812 


-.02981 


1 . 00000 


.62200 


. 62785 


.29159 


. 18(443 


. 06375 


.50444 


.33496 


.30659 


$813 


-.03700 


.62200 


1 . 00000 


.57166 


-.01345 


-.01736 


-. U330 


. 32536 


.24914 


33760 


$814 


.01394 


.62735 


.57166 


1 .00000 


. 14885 


. 17413 


-.00170 


.32342 


. 23623 


.33053 


$813 


.06185 


,29159 


-.01345 


. 14335 


1 .00000 


.34166 


.70018 


.30447 


.27069 


.31 047 


$816 


-.00078 


. 13843 


-.01736 


.17415 


. 54 1 66 


1 .00000 


,62371 


.23381 


.22906 


. 3364 1 


$817 


. 01454 


. 06875 


-.13830 


-.00170 


.70018 


.62371 


1 . 00000 


.23873 


.23603 


.22163 


$8(8 


. 06553 


.50444 


.32536 


.32842 


.30447 


.28331 


.23373 


1 . 00000 


.70716 


. 77359 


$819 


.02003 


.33496 


.24914 


. 28628 


.27069 


.22906 


.23603 


.70716 


1 . 0000^ 


.61521 


$820 


. (3151 


.50659 


.33760 


.33053 


.31047 


. 3364 1 


.22168 


.77359 


.61521 


1 . 00000 


$821 


.10610 


.41716 


.21219 


.25781 


.351 19 


.32377 


.29432 


.61272 


. 76782 


.71337 


$822 


-.06201 


.48638 


.40041 


.43456 


. 08346 


. 17:54 


-.04 068 


. 1 *478 


. 02359 


. 17520 


$823 


-.00291 


.57464 


.41349 


.51031 


. 1 5933 


.17909 


. 06034 


.39633 


.33304 


. J*965 


$824 


-.01 077 


.57195 


.41361 


.52746 


. 1 (653 


. 16393 


-.02122 


.29231 


. 15216 


. 27735 


$823 


. 04856 


.65691 


.48053 


.50504 


.27139 


. 130.9 


. 1 0997 


.45094 


. 34 1 73 


.43708 


$326 


. 08973 


.30575 


. 1522* 


.204 75 


. 1 0782 


-. 02036 


-.00255 


.31494 


. 35364 


.33314 


$327 


.13348 


.45379 


.26168 


.32093 


. 1 9959 


.14150 


. 055*8 


.45736 


.35307 


.49619 


$828 


.17209 


.33123 


. 13618 


.24962 


.23305 


.20063 


. 13061 


.53195 


.4564 0 


.60418 


$329 


.12911 


.36)80 


.19763 


.24643 


. 18329 


. 14635 


. 1 1631 


.46613 


.4391 0 


.54792 


$830 


.08909 


.34517 


.20341 


.26300 


.19621 


. 184 06 


. 1 1319 


.48685 


.43933 


.57022 


$83 1 


.16783 


.30154 


. 1 3343 


. 1 8794 


. 05142 


.07817 


- . 02958 


. 35686 


.2170^ 


. 37823 


$832 


.22545 


.17240 


.09^16 


. 1671 0 


. 1 0056 


.10153 


. 01904 


,23412 


. 1 9269 


^783 
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6601 

6802 
6603 
8804 

saos 

8606 
6807 

6808 
8809 
6610 
Mil 
8812 
8613 

sen 

8815 

8816 

6817 

6618 . 

8619 

S820 

6821 

8622 

€•23 

6824 

6825 

6826 

682? 

6828 

*629 

6830 

6631 

6832 



3821 


S822 


S3 2 3 


S324 




. 32692 


17977 


. 19150 


- , 0364 1 




.29854 


3 1704 


. 1 71 43 


- . 02552 


A ft 1 \ A 


.294 03 


.34 020 


.2716! 


. 34 1 47 


Ilk**?** 


. 2442* 


•6494 0 


. 4 1 5 04 


. 63290 


. ^ w » /O 


.39603 


. 05778 


. 1 956;,' 


. 1 66 1 9 


. 32036 


. 3762* 


.24210 


.35045 


# 33442 


. 47234 


.31599 


. 01798 


. 13570 


• 15395 


. 2421 2 


.23703 


-.16634 


. 0600<< 


- • 03662 


• 20790 


.23628 


-.18426 


. 04953 


- . 1 021 1 


* 1 1599 


.32034 


-.10930 


. 19590 


. 02150 


. 23639 


.10610 


-.06201 


-.00291 


01 077 


• 04856 


.41716 


.48638 


.57464 


.57195 


• 6569 1 


.21219 


.40041 


. 4 1 349 


. 4 1 86 1 


. 43053 


.25781 


.45456 


.51 031 


•52746 


. 50504 


.351 19 


. 08846 


. 1 5933 


• 1 1653 


. 271 39 


.3237/ 


.17154 


. 1 780'* 


• 16895 


■ 15079 


.29432 


-.04 068 


. 06034 


-.02122 


. 1 099/ 


.61272 


.19478 


. 39633 


•29231 


4505)4 


. 76782 


. 02359 


.338U4 


. 1 52 1 6 


. 341/3 


.7133/ 


. 17520 


. 369*5 


.27735 


.4 3703 


1 . 00000 


.05770 


. 3292* 


. 16242 


.34 065 


.05770 


1 . 00000 


. 4*6 Oto 


.77891 


.45402 


.32925 


.46606 


1 . 00000 


.62471 


.42254 


. 16242 


.77891 


.62471 


1 . 00000 


.5087/ 


.34 065 


.454 02 


. 42254 


.50877 


1 . O0OU0 


.3491 1 


-.234 06 


.22563 


- . 05654 


. 1 1252 


.42909 


. 09332 


.3*97/ 


.24 031 


.30399 


.50957 


. 0724 1 


.25419 


.21689 


.31946 


.47178 


. 04693 


.31875 


.21696 


.25171 


.4398.2 


. 08343 


.31 090 


.20356 


. 24825 


.3021 1 


. 19194 


.20091 


.22731 


.24245 


.25795 


. 04 1 76 


. 17143 


. 12334 


.20516 



3326 

.66265 
.3444:2 
. 14483 

-.09014 
.45049 
.36323 
.33998 
.45711 
.33246 
.56415 
. 08973 
.30575 
. 15225 
.20475 
. I 0732 

-.02036 

-.00255 
.31494 
. 35364 
.33314 
.3491 I 

-.234 06 
.22563 

- . 05654 
. 1 1 252 

I .00000 
.49336 
. 37525 
.43446 
.38381 
. 16246 
.22019 



.3/668 

.27347 

. 32630 

. 24498 

.434/8 

.423*02 

.38907 

.24961 

.2/151 

.35370 

. 13343 

.453/9 

.26163 

.32093 

.19959 

. 14150 

. 05593 

.45736 

.353'J7 

.49619 

.42909 

. 09382 

.39977 

.24 031 

.30399 

.49386 

. 00000 

.64355 

.65013 

. 6 1 368 

.51/65 

.43/09 



S323 

.32742 
. 35/06 
.41253 
.29307 
.57344 
. 43954 
.47097 
.24635 
.23306 
.32245 
. 17209 
.38123 
. 18618 
.24962 
.23305 
.20C65 
.13061 
.53»95 
.4564 0 
.60413 
.5 0957 
. 0724 1 
.25419 
.21639 
. 3 1 946 
. 37525 
.64855 
1 . 00000 
.71 153 
.73372 
.50189 
.56514 



S81'9 

. 38031 
.34 002 
.35943 
.2*/36 
.4 '^5 35 
.4031 i 
.41 057 
.29U03 
.23452 
.34342 
. 1291 1 
.36180 
. 19763 
.24643 
. I 3329 
. 14635 
. 1 1631 
.46613 
.4391 0 
.54792 
.47178 
. 04693 
.31375 
. 2 1 696 
.25171 
.43446 
.65013 
.71 153 
1 . 00000 
.33066 
.41324 
.45925 



3330 

. 35543 
360/5 
. 33604 
.290*5 
.54397 
.44 073 
.43/19 
.24363 
.236/0 
.31 173 
. 03909 
.3451 7 
20441 
.26300 
. 1 962 1 
. I34u* 
. t 1319 
.43635 
. 4 3933 
.57 022 
. 43*32 
. 03343 
. 3 I 09 U 
. 20353 
.24325 
33331 
.61 363 
.733/2 
.33066 
1 . 00000 
.4241 1 
.45478 
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Table 24 B 
(Continued) 



S83I 3832 



CO Af 


1 OiM( 
» 1 O^flTW 


. COO f J 




• 1 J 1 c 4 


. 27277 










OA • OA 


t 7a i ^ 




• 35 1 r J 


• 4 0653 




• Z944o 


• 3255 0 




. ZSooz* 


. 36706 


CO AO 


• 1 953T» 


. 26632 




• 23828 


. 264 1 0 


CO 1 A 


•Z4067 


• 25707 


CO 1 | 


• lortM 


.22545 




1AI KX 

• 30 1 34 


• 17240 




. 13543 


• 09716 


CO I a 

©•5 1 ^ 


• lor W 


• 1 or 1 0 


C> 1 K 

9v 1 J 


At 1 .4 ^> 
• U3 14Z 


i A AC/ 

• 1 005o 


fiA 1 & 
OC" 1 O 


• O 1 r 


• 1 0 1 W> 


£3 1 7 




i UI7 U4 


sei 8 




:>C4 1 O 
• «04 1 * 


S£ 1 9 


•Sir W7 


• ■ 9«o9 


$920 


• 37828 




S82I 


.3021 1 


.25795 


S822 


.19194 


.04176 


$323 


.20091 


.17148 


S824 


.22731 


• 12884 


S825 


.24245 


.20516 


S826 


. 1624* 


•22019 


882/ 


.51765 


.48709 


S328 


.50189 


.56514 


S329 


.41824 


.45925 


$830 


.4241 1 


.45478 


$331 


1 .00000 


.55618 


$832 


.55618 


1 .00000 



DETERMINANT OF CORRELATION MATRIX » . 0000000< .66821 1 18E-1 0 > 
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Table 25 

Section 8: Correlation Matrix for each 
Institutional Effectiveness Scale 



Scale 


1 


5 


6 


7 




5 




1.0 








6 




.64 


1.0 






7 




* oz 




1 n 


a 1 pna - • o j 


Scale 


2 


12 


13 


14 




12 




1.0 








13 




.37 


1.0 






14 




. 37 


36 


1 0 


a X pi I a * # u J 


Scale 


3 


15 


16 


17 




15 




1.0 








16 




.29 


1.0 






17 




.36 


.33 


1.0 


alpha=.59 


Scale 


4 


1 


8 


10 




1 




1.0 








8 




.50 


1.0 






10 




.58 


.55 


1.0 


alpha=.78 


Scale 


5 


18 


19 


20 


21 


18 




1.0 








19 




.51 


1.0 






20 




.61 


.41 


1.0 




21 




36 


60 




1 0 alnha- fiH 
J. • w a i ^iia- « ou 


Scale 


6 


22 


23 


24 




22 




1.0 








23 




.31 


1.0 






24 




44 


49 




a i. pii a — • do 


Scale 


7 


2 


9 


ii 




2 




1.0 








9 




.34 


1.0 






11 




.34 


.52 


1.0 


alpha=.67 


Scale 


8 


3 


4 


25 




3 




1.0 








4 




.45 


1.0 






25 




.30 


.35 


1.0 


alpha= . 64 


Sea l'e 


9 


26 


27 


28 


29 30 31 


26 




1.0 








27 




.29 


1.0 






28 




.23 


.55 


1.0 




29 




.20 


.44 


.52 


1.0 


30 




.20 


.47 


.55 


.68 1.0 


31 




.14 


.48 


.48 


.37 .36 1.0 


32 




.20 


.49 


.55 


.40 .39 .51 






alpha 


= .83 
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level is Table 26A. Table 263 reports the results at the 
institution level . 

In the respondent level factor analysis there were 8 factors 
with eigenvalues in excess of 1.0 which in total accounted for 60% 
of the variance. Table 26A indicates (boldface) the items which 
highly loaded on each of the factors. The Institutional 
Effectiveness scale definitions corresponding to the factors are 
also included. 

The only item which did not "fit" into its pre-defined scale 
was item 26. This item was included in the organizational health 
scale but correlated more highly with the student personal 
development scale. However , upon inspection of the wording of 
this item (student/faculty relationships) it appears its loading 
on the Student Personal Development scale is justifiable. Items 
from institutional effectiveness scales 2 (student academic 
development) and 8 (ability to acquire resources) loaded onto the 
same factor. 

The institution level factor analysis, reported in Table 26B, 
produced seven factors with eigenvalues greater than 1.0. These 
factors accounted for 72% of the variance. As in the respondent 
level factor analysis, item 26 loaded *nore highly onto the factor 
defining scale four than onto the factor defining scale nine. 
Again, items from scales two and eight loaded onto the same 
factor, as well as items from scale six (professional development 
and quality of faculty). 



ERLC 
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Table 26A 



Factor Analysis of Section 8 Items 
Respondent Level 

Factor 



I tew 


i 


2 

*- 




4 




e. 

D 


7 


p 

0 


26 


.20 


.01 


.45 


.12 


.04 


.03 


.01 


.09 


27 


.64 


.12 


.17 


.12 


.12 


.09 


.09 


.07 


28 


. 68 


1 6 

• X U 


. X o 


1 7 
• x / 


• z u 


• ID 


• U / 




29 


.63 


.10 


.13 


.14 


.22 


-.00 


.02 


.08 


30 


.64 


.11 


.13 


.16 


.23 


-.00 


.04 


.07 


31 


.57 


.22 


.03 


.06 


.08 


.18 


.04 


.06 


32 




• XV 


.in 

• X v 


1 1 

• XX 


OR 


• ID 


0 f, 


i U J 


12 


.14 


.58 


.18 


.13 


.17 


-.02 


.11 


.12 


13 


.08 


.51 


.13 


.02 


.02 


-.05 


.01 


.13 


14 


. 12 

• X £- 


. 45 


15 

• X *J 


OR 


06 


1 0 
. X u 


1 'J 


1 1 


3 


.22 


.48 


.07 


.05 


.13 


.22 


-.03 


-.00 


4 


.19 


.60 


-.01 


.07 


.12 


.15 


-.02 


.11 


25 


. 12 

• X 


. 50 


09 


1 4 


1 0 

. X v 


04 


• 1/ 


1 A 


1 


.14 


.16 


.72 


.12 


.09 


.09 


.02 


.01 


8 


.06 


.09 


.62 


.08 


.08 


.27 


-.04 


-.01 


10 


.13 


.23 


.65 


.09 


.12 


.24 


-.01 


-.00 


5 


.25 


.16 


.17 


.70 


.13 


.11 


.05 


.01 


6 


.18 


.20 


.13 


.73 


.12 


.08 


.11 


.09 


7 


.22 


.04 


.14 


.72 


.10 


.07 


.09 


.07 


18 


.34 


.26 


.11 


.17 


.49 


.04 


.09 


-.02 


19 


.20 


.13 


.12 


.07 


.71 


.03 


.06 


.02 


20 


.40 


.24 


.10 


.19 


.49 


.09 


.10 


.04 


21 

£m X 


27 


OQ 






• D % 


n q 


• 1U 


• u y 


2 


.27 


.12 


.20 


.08 


.11 


.35 


.15 


.07 


9 


.15 


.07 


.35 


.09 


.08 


.63 


.07 


.06 


11 


.15 


.10 


.17 


.08 


.03 


.60 


.07 


.05 


15 


.06 


.13 


.07 


.07 


.04 


.00 


.55 


.01 


16 


.07 


.07 


-.09 


.09 


.05 


.09 


.51 


.07 


17 


.04 


-.04 


.01 


.00 


.07 


.04 


.63 


.02 


22 


.03 


.41 


-.10 


.06 


-.00 


.05 


.00 


.42 


23 


.15 


.25 


.14 


.06 


.10 


.07 


.11 


.55 


24 


.08 


.33 


.02 


.06 


.02 


.04 


.06 


.67 




Factor Institutional Effectiveness Scale 

1 9 Organizational Health 

2 2 Student Academic Development 
8 Ability to Acquire Resources 

3 4 Student Personal Development 

4 l Student Educational Satisfaction 

5 5 Faculty & Administrator Employment Satisfaction 

6 7 System Openness & Community interaction 

7 3 Student Career Development 

8 6 Professional Development & Quality of Faculty 
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Table 26B 



Factor Analysis of Section 8 Items 
Institution Level 



I tern 


1 




•3 
J 


12 


.76 


.18 


.26 


13 


65 


• U 4 


99 


14 


68 


1 1 
» 11 


91 
• £ X 


22 


.80 


-.00 


-.32 


23 


61 


9 1 

• c. X 


1 ^ 
• X J 


24 




1 9 
• J. ^ 


— • XO 


3 


47 


9 7 


OR 
. U O 


4 


75 


1 R 


— 1 ^ 
• J. 3 


25 


64 


07 


1 9 
• X c. 


26 


-.02 


.33 


.69 


27 


25 


6Q 


96 


28 




75 

• I J 


1 1 
• J. X 


29 


.15 


.77 


.21 


30 


.15 


.76 


.16 


31 


.22 




- nn 


32 


. 09 


58 


OR 

. VI o 


1 


.06 


.21 


.84 


8 


.04 


.09 


.68 


10 


17 


»1 J 


7Q 


18 


.32 


.31 


.18 


IS 


.17 


.22 


.29 


20 




40 


1 A 


21 


17 


33 


1 Q 


15 


.12 


.07 


.04 


16 


10 


1 1 


- 9 9 


17 


-. 08 


01 




5 


.12 


.38 


.20 


6 


.36 


.25 


.18 


7 


.06 


.30 


.12 


2 


-.02 


.35 


. 23 


9 


-.05 


.19 


.36 


11 


-.04 


.13 


.06 



Factor 



4 


C 

D 


C 

0 


/ 


.17 


.15 


.14 


-.08 


. ID 


— 1 A 

— • X 4 


nn 


— . 11 


0^ 


1 0 


i n 
• xu 


n i 
— . U 1 


-.03 


.00 


.03 


-.02 


07 


• X 0 


f\A 


n o 
-.Uo 


- 09 


n / 


n q 
• uy 


— • U J 


91 
• £ X 


• \Jy 


0/1 
• U4 


• ly 


1 7 
• x / 


— OR 
• u o 


— • VI 


• X £ 


99 


• XX 


1 Q 
• Xo 


n ^ 


.06 


.07 


.21 


-.05 


OQ 


1 0 


• X J 


n i 
• U 1 


98 


OQ 
• U y 


9 7 


n o 
• Uo 


.20 


.09 


.12 


.02 


.23 


.09 


.18 


-.01 


1 9 
• x £ 


- 07 


no 


o n 


05 


— 01 
• U X 


1 7 

• x / 


9 9 


.17 


-.06 


.11 


.11 


.19 


-.14 


.09 


.36 


. £ X 


— 19 

• X £ 


n 7 


.19 


.62 


.19 


.20 


.01 


.73 


.19 


.09 


-.04 


61 
. OX 


1 Q 


O 7 


• Uo 


66 


• Zy 


n q 
• Uo 


n £ 
• Uo 


.13 


.74 


.10 


.07 


i ^ 

. X J 


70 


1 Q 
• XO 


— • U4 


i ^ 


R5 


• ux 


n >i 
• U4 


.19 


.10 


.74 


.14 


.15 


.15 


.71 


.05 


.11 


.14 


.77 


.18 


.04 


.24 


.04 


.28 


.05 


.06 


.10 


.70 


-.03 


.03 


.12 


.70 




Factor Institutional Effectiveness Scale 

1 2 Student Academic Development 

6 Professional Development & Quality of Faculty 

8 Ability to Acquire Resources 

2 9 Organizational Health 

3 4 Student Personal Development 

4 5 Faculty & Administrator Employment Satisfaction 

5 3 Student Career Development 

6 1 Student Educational Satisfaction 

7 7 System Openness & Community Interaction 
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■ Group Differences 

As previously noted, one means of investigating an 
| instrument's construct validity is through the study of group 

^ differences. This form of assessment is appropriate if our 

■ understanding of a construct leads us to expect that members of 
m two groups should respond differently on the questions that 

operationalize the construct. Organizational Studies staff have 
M completed two studies that utilize the national study data to 

compare the responses of members of different groups. In 
| addition, an analysis was also done that allows us to compare the 

m scores of public and private institutions on the items in the 

instrument. We shall begin with the last set. 

■ The data in Table 27 report the mean and standard deviation 
for all items in the instrument for public and private 

| institutions separately. Because of the large sample sizes, when 

_ item means differ by more than .15 01 the 5-point scale items, 

that difference is generally significant at p<.05. Differences 

■ greater than .20 are generally sigificant at p<.01. Comparison of 
the means in Table 27 indicate that the groups significantly 

| differ on most of the items in the instrument. 

^ Differences between public and private groups generally 

■ conform to expectations that follow from our stereotypes. For 

■ example, concentrating on the items in Section 4, we see that 
public institutions are generally perceived by their members as 

■ having more administrators performing specialized functions; 
employing more formal policies; having less of a special identity; 

■ having programs that reflect the mission, and so on. The items in 

I -98- 
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Table 27 

Means and Standard Deviations for Each Item 
by Institutional Control 
Institution Level (n=334) 



Public Private 
(n=127) (n=207) 



Section 


Item 


Scale 


Mean 


Std. Dev. 


Mean 


Std. Dev. 


1 


1 


SD-SA* 


3.0 


.49 


3.0 


.41 




2 


SD-SA 


3.6 


.50 


3.3 


,37 




3 


SD-SA 


3.4 


.33 


3.4 


.28 




4 


SD-SA 


2.6 


.37 


2.8 


.36 




5 


SD-SA 


3.5 


.53 


3.8 


.41 




6 


SD-SA 


4.0 


.53 


4.3 


.31 




7 


SD-SA 


2.8 


.61 


2.4 


.53 




8 


SD-SA 


4.3 


.41 


3.8 


.49 



1 


% yes 


46.0 


38.85 


63.8 


34.73 


2A 


% yes 


36.8 


37.37 


24.4 


27.14 


2B 


% yes 


40.6 


35.70 


36.7 


31.75 


2C 


% yes 


54.7 


34.53 


53.1 


34.21 


2D 


% yes 


57.9 


40.14 


72.7 


33.42 


3 


SD-SA 


3.1 


.70 


3.0 


.56 


4 


SD-SA 


2.4 


.76 


2.6 


.85 


5 


SD-SA 


3.2 


.69 


3.4 


.50 


6 


SD-SA 


2.8 


.93 


2.5 


.70 


1 


% yes 


64.2 


28.83 


38.0 


28.26 


2A 


% yes 


44.0 


27.23 


26.0 


28.79 


2B 


% yes 


62.0 


28.55 


38.9 


34.05 


2C 


% yes 


80.4 


27.13 


61.1 


34.43 


2D 


% yes 


84.4 


21.64 


70.6 


34.32 


3 


SD-SA 


3.4 


.55 


3.2 


.66 


4 


SD-SA 


2.8 


.70 


2.7 


.91 


5 


SD-SA 


2.8 


.59 


3.3 


.62 


6 


SD-SA 


2.2 


.53 


2.5 


.77 



1 


SD-SA 


3.4 


.58 


3.3 


.53 


2 


SD-SA 


3.6 


.42 


3.4 


.44 


3 


SD-SA 


3.1 


.75 


3.4 


.61 


4 


SD-SA 


3.8 


.49 


4.0 


.51 


5 


SD-SA 


4.0 


.35 


4.0 


.35 


6 


SD-SA 


3.3 


.52 


3.6 


.50 


7 


SD-SA 


3.6 


.39 


3.8 


.35 


8 


SD-SA 


3.1 


.43 


3.0 


.44 


9 


SD-SA 


3.5 


.50 


3.5 


.46 


10 


SD-SA 


2.7 


.60 


2.5 


.65 


11 


SD-SA 


3.5 


.41 


3.6 


.43 


12 


SD-SA 


2.7 


.47 


2.6 


.44 


13 


SD-SA 


3.1 


.52 


2.9 


.51 


14 


SD-SA 


2.4 


.66 


2.4 


.67 


15 


SD-SA 


3.0 


.57 


3.1 


.53 


16 


SD-SA 


2.9 


.56 


2.7 


.52 


17 


SD-SA 


3.2 


.43 


2.9 


.44 



q *SD-SA = strongly disagree to strongly agree where 

strongly disagreed, disagree«2, neither »3, agree«4, i 00 
wAhi strongly agree-5. lotZ 
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Section 



Public Private 
(n=127) (n=207) 



Item 


Scale 


Mean 


Std. Dev. 






18 


SD-SA* 


3.2 


.52 


3 4 


53 


19 


SD-SA 


3.4 


.42 


3.4 


.39 


20 


SD-SA 


2.9 


.52 


2.6 

X . V 


.55 


21 


SD-SA 


3.2 


.52 


2.7 


.46 


22 


SD-SA 


2.9 


.85 


2.9 


.58 


1A 


0-100 


pts. 


36.3 


15.91 


56.6 


14.91 


IB 


0-100 


pts. 


18.3 


8.86 


19.0 


9.15 


1C 


0-100 


pts. 


25.5 


12.38 


13.5 


8.94 


ID 


0-100 


pts. 


19.8 


9.50 


10.9 


7.14 


2A 


0-100 


pts. 


14.8 


13.97 


18.4 


13.94 


2B 


0-100 


pts. 


22.0 


13.05 


21.9 


14.58 


2C 


0-100 


pts. 


44.4 


14.92 


43.3 


13.85 


2D 


0-100 


pts. 


18.9 


11.40 


16.3 


11.13 


3A 


0-100 


pts. 


33.3 


14.33 


51.9 


15.25 


3B 


0-100 


pts. 


17.8 


10.31 


16.8 


10 51 

XV/ . _*>x 


3C 


0-100 


pts. 


24.4 


11.91 


12.7 

XX . / 


7 25 


3D 


0-100 


pts. 


24.6 


8.16 


18.6 


7 64 


4A 


0-100 


pts. 


26.2 


11.48 


37.1 


12.23 

XX . X — ' 


4B 


0-100 


pts. 


25.8 


11.64 


22.3 


9.82 


4C 


0-100 


pts. 


26.0 


12.14 


24.0 


9 66 

^ . vv 


4D 


0-100 


pts. 


22.0 


8.89 


16.7 


8.11 

\J . X X 


1 


SD-SA 


3.4 


.55 


3.5 


• 48 


2 


SD-SA 


3.1 


.48 


3.1 


51 


3 


SD-SA 


3.6 


• 48 


3.8 


33 


4 


SD-SA 


2.4 


.39 


2 6 

X • U 


• JD 


5 


PD-SA 


2.7 

Mm . # 


.46 


2.8 


50 


6 


SD-SA 


2.9 


.56 


2.8 


.61 


7 


SD-SA 


3.8 


.43 


3.8 


.39 


8 


SD-SA 


3.6 


.38 


3.7 


36 


9 


SD-SA 


3.3 


.45 


3.3 


44 


10 


SD-SA 


3.4 


.46 


3.5 


45 


11 


SD-SA 


2.9 


.49 


2.9 


45 


12 


SD-SA 


3.2 


.56 


3.4 


.57 


13 


SD-SA 


3.8 


.41 


3.9 


.42 

. » X 


14 


SD-SA 


2.3 


.44 


3.0 


39 

. J7 


1 


SD-SA 


3.2 


.50 


3.1 


. *tx 


2 


SD-SA 


2.5 

Mm . mJ 




2 5 


59 

. JX 


3 


SD-SA 


3.0 


.45 


3.2 


46 


4 


, SD-SA 


3.4 


.41 


3.5 


38 


5 


SD-SA 


2.5 


.43 


2.5 


.40 


6 


SD-SA 


2.8 


.49 


2.6 


.43 


7 


SD-SA 


2.9 


.42 


2.7 


.43 


8 


SD-SA 


2.6 


.50 


2.5 


.45 


9 


SD-SA 


3.1 


.46 


3.3 


.44 


10 


SD-SA 


3.5 


.36 


3.7 


.35 


11 


SD-SA 


2.1 


.42 


1.9 


.35 


12 


SD-SA 


3.0 


.38 


3.0 


.41 



O SD-SA ■ strongly disagree to strongly agree where i oo 
strongly disagreed , disagree-2, neither-3, agree«4, loo 
strongly agree«5. -100- 



■ Section 4 on which public and private institutions do not 
significantly differ include: programs reflecting the mission of 

■ the institution; decision centralization; innovative activity; 
morale; and cutbacks. 

■ As previously noted, Organizational Studies staff completed 
m two studies pertaining to the assessment of group differences. 

The study by Krakower and Zammuto (1983) was concerned with 

■ assessing whether respondent? in institutions experiencing 
significantly different enrollment and revenue conditions viewed 

M their institutions differently. The study examines if-and-how 

m differences in institutional revenue and enrollment conditions are 

related to item scores in Sections 1 # 4, 6, 7, and 8. The results 

■ of the study generally reflect the kinds of differences on the IPS 
that one would expect to find as a function of differences in 

J enrollment and revenue conditions. 

_ The study by Chaffee and Krakower (1984) was concerned with 

■ assessing how managers in higher education organizations differed 
m in their perceptions of institutional performance as a function of 

resource predictability. The results of the study suggest either 

■ that many of the prevailing assumptions about how resource 
predictability should be related to responses or the IPS are 

■ incorrect; and/or the IPS is doing a poor job of measuring the 

■ constructs examined. 

■ Changes Over Occasions 

No effort has been made to test how performance on the IPS 

■ changes over time. Data has been collected from eight 

| -101- 
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institutions that could be used to examine how institution scores 
might change in a little more than one year. However, this 
discussion will be postponed in favor of including it as a part of 
the assessment concerned with evaluating the instrument's 
reliability. 



Conclusion 

The results of the preceding set of analyses generally 
suggest that the IPS is measuring the constructs or dimensions it 
purports to assess. Specifically, the results of the item 
analyses, internal consistency analyses, and factor analyses 
support the instrument's claims with respect to Sections 1, 2, 3, 
4, 5, and 6. The construct validity of the instrument appears 
weakest with respect to Sections 7 and 8. 

The studies comparing different groups' performance on the 
IPS lead to generally positive conclusions. 
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Concurrent Validity 
As previously noted, concurrent validity is concerned with 
the relationship between test sccres and an accepted criterion of 
performance on the dimensions the test purports to assess. The 
reason for constructing a test for which one already has data is 
that the test saves t;me and expense, yet yields the same results 
as the criterion measure (Ebel, 1972; Cronbach and Meehl, 1967). 
This form of validity is usually evaluated in terms of the 
correlation between the test and criterion measure. 

Unfortunately, no criterion data are available with respect 
to the IPS thaf might be used to estimate a concurrent validity 
index. However, ethncsraphic data are available for eight 
institutions that used the IPS in an NCHEMS case study research 
project. The purpose of the case study research was to 
investigate the nature and impact of administrative strategy on 
various aspects of institutional performance. A purpose not 
altogether unrelated to the IPS. 

It would be inappropriate to judge the concurrent validity of 
the IPS solely on the extent to which it mirrored wh^ was 
reported in the ethnographies. However, it seems reasonable to 
expect that the IPS should reflect and support the findings of the 
caso studies— especially in view of the fact that the results of 
the case studies are based, at least in part, on IPS data. 

To the extent it is appropriate to compare the IPS results 
and ethnograrhy for this institution, a number of similiarities 
and differences are apparent. The IPS data generally support 
what is reported in the ethnography. However, the IPS fails to 
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capture or reflect the interrelationships between the dimensions 
assessed. This is not surprising in view of the modular nature of 
the instrument — that is, it is concerned with assessing single, 
relatively unique dimensions of performance. The IPS is certainly 
not alone doing this. However, the comparison reveals that its 
modular nature may obscure, and/or be insensitive to important 
institutional dynamics. 

Second, if we assume the ethnography reflects the truth then, 
at least with respect to this particular institution, the IPS does 
a fairly poor job of measuring two dimensions — culture and morale. 
That is, it laiib to adequately capture or depict the actual 
nature of these conditions. Third, the IPS appears to be 
insensitive to a number of factors that appe_r to have a 
significant impact on this institution's performance — the 
disorganized nature of its curriculum, and the nature of 
decision making. 
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Reliability 

Common synonyms for reliability include dependability, 
consistency, and stability. Reliability problems are concerned 
with "the accuracy with which a measuring inFtrument, e.g., a 
test, measures whatever it measures (Magnusson, 1967, p. 60)." 
Formally stated, the evaluation of tne reliability reduces to 
determining .ow much of the variation in a set of test scores is 
due to certain systematic differences among the individuals in the 
group and how much to other sources of variation that are 
considered, for particular purposes, errors of measurement. 

There are numerous ways in which we can assess a test's 
reliability. One entails administering a test to the same group 
of individuals on two different occasions and correlating their 

jsponses. This correlation is called a reliability coefficient, 
and is formally refered to as "test-retest" reliability. 

A second entails examining the relationship between parallel 
forms of the same test— where these forms are extracted from the 
instrument in question. We often rely on this procedure where 
retesting is not feasible because 1) people who take part in 
testing are affected by the first testing procedure; and/or 2) 
individuals may have changed on the dimensions in question between 
testings. Reliability estimates resulting from this form of 
assessment are referred to as internal consistency coefficients. 

A third type of reliability that is pertinent when we are 
interested in estimating the agreement between sets of ratings, 
test scores or ether measures is called rater reliability. This 
form of reliability is estimated by employing a repeated measures 
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analysis of variance model to obtain estimates for the true and 
total score variance in the set of ratings (Ebel, 1967; Winer, 
1962). The reliability coefficient produced by this form of 
analysis is referred to as an intraclass correlation. The 
procedure provides an estimate of the degree of agreement or 
similarity between judges' ratings of an object or set of objects 
(e.g., persons, institutions).! 



Test-Retest Reliability 

No adequate data are available to assess the test-retest 
reliability of the IPS. The IPS was administered twice in the 
case study institutions. However, responses on both 
administrations were anonymous, obviating assessment at the 
individual level. Basing an estimate on institution mean scores 
would, at least for the case study institutions, be inappropriate 
for two reasons. 

First, there were significantly different numbers of 
respondents in each of the two administrations. The first 
administration generally involved less than a dozen respondents of 
varying backgrounds—faculty, administrators, and trustees. 



1 kn illustration of what the coefficient reflects within the 
current context may be useful. If everyone in institution A rates 
an item a "5," and everyone in institution B rates the same item a 
"1," the intraclass correlation (which is based on the ratings of 
judges in both institutions) will he 1.0. Conversely, if each 
judge in each institution rates the item differently, then the 
intraclass correlation coefficient will be zero—even though, for 
example, the mean for the item may be the same in both 
institutions. The intraclass correlation provides a measure of 
within-class or wi thin-institution agreement. 
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■ Institutional means based on so few cases are likely to be highly 
unreliable. 

■ Second, more than one year elapsed between the first and 

m second administration of the IPS. Hence, observed differences in 

scores may be due to actual changes in institutional conditions. 

Internal Consistency Reliability 
W As previously noted, five of the eight sections of the IPS 

■ (Sections 1, 2, 3, 4, and 6) include questions that are intended 
to measure relatively unique dimensions. To estimate this form of 

■ reliability for these sections would be inappropriate. The 
questions in Sections 5, 7, and 8, measured predefined scales. 

| Discussuion of the results of analyses pertinent to these sections 

^ are included in the section on construct validity. 

■ Rater Reliability 

The current version of the IPS Executive Report graphs the 
J mean rating of each item by each study group. Item response 

_ frequencies are not reported. Reporting scores in this format 

■ assumes that group members 1 scores may be meaningfully aggregated. 

■ The truth of this assumption may be tested by estimating the 
intraclass correlation coefficient for each item of the 

I instrument. 

The procedure employed to carry out this analysis was taken 

■ from an article by Robert Ebel (1967). Estimates of the 

■ intraclass correlations were obtained by employing the following 
formula: 
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MS - M 
r= 

I1S + ( k O-l)M 

where MS is the mean square for institutions 

M is the error including the between-raters variance 

and k 0 is the average nuin b er G f raters per institution 
1 

k o= ----- [sum of k - (sum of k2 / sum of k ) ] 

where n= the number of institutions 

k= number of raters per institution 

The results of the analyses for all items except those in 
Section 5 are reported in Table 28. The items in Section 5 were 
excluded from this analysis because respondents were required to 
assign four different scores to an item. Estimated coefficients 
range between 0 and .60. However, more than 80% of the 
coefficients are 3ass than .30. The generally low nature of these 
estimates suggest that it is inappropriate to believe that group 
means fairly reflect the perceptions of individual group members. 
In other words, employing group means to draw conclusions about 
perceptions of institutional performance, or to make 
generalizations about conditions, may lead to spurious 
conclusions. This suggests that 1J the IPS must include frequency 
data for each group on each item— see, for example, Figure 1; and, 
2) that the "Executive Report" be rewritten to address this 
problem. 
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Table 28 

Reliability of Individual Ratings 
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n=1321 


n=1158 


n=927 


n=3406 


1 


.07 
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6 


.17 


.15 


.14 
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Administrators Faculty Trustees Total 
Section Item n=1321 n=1158 n=927 n=3406 
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Figure 1 
Example Item Frequency Data 



SECTION 1 



roup 




Response in percent 






Std 




1 


2 


3 


4 


5 


Mean 


Dev 


N 


A 


.0 


40.0 


20.0 


40.0 


.0 


3.0 


1.0 


5 


B 


.0 


60.0 


40.0 


.0 


.0 


2.4 


.5 


5 


C 


12.5 


25.0 


.0 


50.0 


12.5 


3.2 


1.4 
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16.7 


38.9 


16.7 


16.7 


11.1 


2.7 


1.3 


18 
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11.1 


38.9 


5.6 


33.3 


11.1 


2.9 


1.3 


18 
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.0 


42.9 


14.3 


42.9 


.0 


3.0 


1.0 
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9.8 


39.3 


13.1 


29.5 
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1.1 
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38.9 
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1.2 
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.0 


42.9 


.0 


57.1 


.0 


3.1 


1.1 
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1.6 


38.7 


11.3 


41.9 


6.5 


3.1 


1.1 


62 
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Key: A-Trustees 

B»Executive Adninistrators 
Operations Adninistrators 
D-Liberal Arts & Sci Faculty 



E-Professional Sen Faculty 
F=Phys&Biol Sci Faculty 
X-All Respondents. 
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| Conclusion 

^ In general, the Institutional Performance Survey appears to 

■ do a reasonably good job of assessing most of the constructs or 

■ dimensions it purports to measure. Its most serious problems 
include the 1) use of ambiguous language; 2) weak assessment of 

■ two of the six scales in Section 7 (Bureaucratic Allocation, and 
Political Allocation), and probably three of the nine scales in 

| Section 8 (Student Academic Development, Professional Development 

_ & Quality of the Faculty, and Ability to Acquire Resources); 3) 

lack of a "Don f t Know" response category in the questionnaire; and 

■ 4) lack of item-response frequencies in the Executive Report. It 
would seem that all of these problems can be easily remedied. 

| In considering the overall utility of the instrument two 

_ factors appear to be critical. First, it seems that the best and 

■ most appropriate use of the IPS is to employ it as a means of 

■ begin ning an institutional self-study. That is, the IPS appears 
to do a fairly good job of identifying many institutional 

J strengths and weaknesses. However, failure to seriously 

investigate 1) what an institution^ scores on the dimensions 

■ assessed actually mean; and 2) hr>w conditions are related and 

■ impact one another — may lead to spurious or inappropriate 
conclusions. 

■ Second, the most critical factor determining the utility of 
the IPS is the extent to which participants in the assessment 

I process believe that their efforts will have an impact on 

m institutional conditions. The utility of the instrument is not 

primarily a function of what it measures or fails to measure. 
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Rather, its utility is primarily a function of the commitment and 
expectation of those involved that something positive will 
actually come from their efforts. 
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Institutional Performance Survey 



Introduction 

This report is an administrative digest of the responses made by members 
of your institution to the NCHEMS Institutional Performance Survey (IPS). It 
is accompanied by a statistical report that presents more detailed information 
about responses to the questions. IPS provides administrators with information 
abojt institutional characteristics, functioning, and performance, as judged by 
various members of your institution. The results allow you to compare the 
perceptions of various groups within your institution, such as faculty, 
administrators, and trustees. And if you decide to readminister the IPS at a 
later date, the materia, contained in the report can us used as baseline 
information. This will allow you to determine how institutional functioning 
and performance have changed over tins. 



Content and Organization of the Report 

This report is divided into eight sections. Section 1 examines the topic 
of environmental change. It indicates how members of your institution view 
competition with other institutions, the availability of financial resources, 
and changes in the supply of potential students. Sections 2 and 3 focus on 
institutional enrollments and revenues. They examine the extent to which 
individuals in different groups share beliefs about past enrollment and revenue 
trends. These sections also consider perceptions about future enrollments and 
revenues and thc^r potential impact on the institution. 

Section 4 provides an overview of institutional functioning and 
characteristics. It covers such topics as your institution's mission, morale, 
areas of potential or real conflict, and the credibility of top administrators. 
Section 5 examines the culture of your institution; it allows you to determine 
whether leadership style, institutional emphases, and mechanisms for creat.ng 
institutional cohesion are congruent. 

Section 6 provides an overview of institutional strategy. The topics 
focus on innovation, resistance to change, and planning. Section 7 focuses on 
the resource-allocation process, and presents respondents' perceptions of how 
resource-allocation decisions are made. Section 8 provides information about 
institutional effectiveness on nine different dimensions of performance, such 
as student academic development, faculty and administrative morale, and 
organizational health. 
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Guidelines for Interpretation 



Each section begins with a brief explanation of the Items that It covers 
and Includes Information that will be useful to you when Interpreting the 
results. All results are reported 1n histogram form. The first few bars of 
each 'ilstogram indicate the average response for each group participating in 
the survey. A key Identifying the groups 1s located at the bottom of each 
page. The last bar presents a summary score for your Institution. The summary 
stores are the average of all Individual responses for each Item. 

You can get the most out of the Information presented 1n this report If 
you keep a few simple questions 1n mind as you examine the results. With 
respect to responses from different groups within your Institution, ask 
yourself, "How varied are these responses?" "Are the responses fairly uniform 
across groups, or do some groups strongly disagree with others?" Can you think 
of plausible reasons for such differences? Do these differences Indicate 
possible problems within your Institution? 

The separate statistical appendix helps you examine specific Items or 
scales Included 1n this general report. The statistical report contains a 
detailed description of the responses reported here in histogram form. 
Included are such items as means, standard deviations, and number of responses 
for each respondent group. It also provides an analysis of variance for each 
item or scale thot Indicate* the extent to which differences among respondent 
groups are statistically significant. When group differences for an item are 
statistically significant (p<.05), the page following the analysis of variance 
provides a post hoc means test that Identifies the statistically significant 
group differences. You can use this information to examine more closely those 
questions that are of particular interest to you. 

Before you interpret the resulvs of the survey, it 1s important that you 
consider the respondent information on page 4 of this report. The last column 
of the table provides the response rate for each group, which is the number of 
questionnaires returned by individuals in a group as a percentage of the number 
of questionnaires distributed to individuals in that group. The response rata 
for a group 1s an Important consideration in assessing the extent to which the 
information contained in this report may or may not be representative of the 
group as a whole. Generally, the greater the proportion of individuals 
responding, the greater the confidence you can have that the information 
contained in the report 1s an accurate representation of that group's 
perceptions or beliefs. However, if only a small proportion of individuals 
from any group responded to the survey, it 1s useful to ask yourself why this 
was the case. For example, it might indicate a poor relationship between 
groups in the Institution, such as between the administration and faculty. 
Carefully exam Ming the respondent information on page 5 helps you set the 
context withlr which to study the responses to the items and scales in the 
survey. 

Having considered the respondent information, you should now examine 
specific items in each section. When you find an item that is of particular 
Interest, the statistical report can help you determine the degree of 
confidence that can be placed 1n the replies from one or more respondent 
groups. 
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With respect to overall 1n:ti tutional scores, you should compare how your 
Institution scored with how you think 1t ought to have scored. If there Is 
large divergence between actual and preferred scores, you should ask whether 
the actual scores reflect transitory conditions 1n the Institution or indicate 
longer-term problems requiring administrative attention. 



Using the Report 

IPS offers you an exceptional opportunity to assess your institution's 
performance. The executive report and statistical appendix that you have 
before you provide reli.ble information about where change might be needed. 
Although this report 1s a key element in the assessment process, it cannot 
Itself provide ready-made answers. IPS is not a product but a tool. The 
ultimate success of the survey depends on the thought this report provokes, the 
discussion it elicits, and the action it prompts. Because every institution is 
unique, we cannot present specific recommendations regarding the use and 
circulation of the report. Nevertheless, we do offer several suggestions. 

A large number of individuals in your institution have taken time out from 
their busy schedules to complete the questionnaire. It is appropriate that you 
acknowledge their interest and concern in the institution. You can do so by 
communicating tne results to them and including them in discussions about their 
implications. Some parts o" the survey may pinpoint real or potential sources 
of conflict within your institution. The interests of all concerned are 
furthered by open discussion of these points. Sidestepping these Issues would 
only defeat the purpose of IPS and, more importantly, reduce the effectiveness 
of your institution. 

IPS can focus campuswide discussion about a variety of Issues that relate 
to institutional effectiveness. Indeed, we suggest that you consider using IPS 
as the centerpiece for institutional self-study. Not only does IPS raise 
important issues itself, it also provides a framework within which to orient 
and place discussion of more specific questions. 

The effectiveness of IPS as a self-study tool is enhanced by Its many 
potential applications. For example, IPS can play a useful role 1n an upcoming 
accreditation study or in a review of institutional mission. The Instrument 
can also help you understand the implications of a recent or future 
reorganization of your institution or its administration. If you are 
contemplating a change in leadership, such as a new president, IPS can help you 
understand what qualities of leadership would best match your Institution. In 
turn, IPS can help orient the new leader to your institution. Indeed, wherever 
communication in your institution is important, IPS can help you sort out the 
perceptions held by different groups and identify real or potential areas of 
conflict. 

Remember that the effectiveness of IPS hinges on the use you make of 1t. 
The information contained in this survey is ultimately a reflection of the 
interest that members of your institution take in its health. Constructive 
change occurs when you tap that concern and commitment. 
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I 

M Groups 
^Trustees 

|Execut1ve-level Administrators 
Operations-level Administrators 
J-iberal Arts and Science Faculty 
'rofessionai .chool Faculty 



i 



hysical and Biological Science 
Faculty 

Totals 



Respondent Information 



No. Questionnaires No. Usable Group 
Distributed Questionnaires Returned Response Rate 



0 


0 




5 


4 


80% 


10 


7 


70% 


30 


10 


33% 


10 


3 


30% 


15 


5 


33% 


85 


29 


34% 
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SECTION 1: Changes in the Institutional Environment 



This section assesses how respondents view the institution's environment. 
They were asked whether it is becoming more or less predictable and benevolent 
and whether they felt it now holds fewer or greater resources. The items in 
this section focus on changes in factors related to enrollments and revenues 
and to competition with other institutions. This information can help you 
determine whether various groups view your institution's environment in the 
same way. Major differences among their perceptions can be a source of 
disagreement. 



QUESTION EXPLANATION 

!• Enrollment Predictability . Low scores indicate that there is greater 
uncertainty about future enrollments and that factors affecting 
enrollments are becoming less predictable. 

2. Revenue Predictability . High scores indicate that factors affecting 
institutional revenues are becoming less predictable, thus increasing 
uncertainty about future revenues. 

3. Competitor Predictability . High scores indicate that competitive 
actions by other institutions have become more unpredictable, thereby 
creating higher levels of uncertainty for your Institution. 

4. Students' Tastes and Preferences . High scores Indicate that 
students' tastes and preferences have become less predictable. This, 
in turn, may indicate increased difficulty in planning programs to 
maintain enrollment levels. 

5. Intensity of Competition . High scores Indicate that respondents 
perceive the competitive actions of other colleges and universities 
as affecting your institution in more areas now than 1n the past, 
thus creating greater uncertainties for the institution. 

6* Enrollment Competition . High scores indicate that competition with 
other colleges and universities for prospective students is perceived 
as having increased during the past fev years. 

7 « Supply of Students . High scores reflect the perception that the 
supply of potential students has grown. 

8. Availability of Financial Resources . High scores indicate that 
respondents perceive greater difficulty in obtaining financial 
resources. 



Preliminary analyses at NCHEMS suggest that schools can score quite 
differently on these items. For example, respondents at public institutions 
report greater uncertainty and difficulty in obtaining financial resources over 
the past few years than do respondents at novate institutions. In contrast, 
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respondents at private institutions report more uncertainty about and greater 
competition for future enrollments than do respondents at public institutions. 

Program differences also affect perceptions of environmental change. 
Respondents are institutions with a heavy investment in liberal arts and 
science programs report greater uncertainty concerning enrollments and perceive 
higher levels of competition than do respondents at institutions with a heavy 
emphasis on professional programs. Institutions offering both types of 
programs should examine discrepancies in scores among different faculty groups. 
If there are sizable discrepancies, you should ask whether these groups cright 
perceive inequities within the institution. Such perceptions can be * 
potential source of conflict. 

It may also be valuable to examine the extent to which respondents' 
perceptions are realistic, and whether they seem to be commenting on the past, 
the future, or both. That is, administrators usually know whether enrollments 
and revenues have become less predictable or more scarce— but many other 
respondents answer on the basis of their own perception and less on the basis 
of fact. How well-informed are respondents? Could more information Improve 
their attitudes or help them find ways to help the institution? Do they have a 
false sense of security from reliance on past conditions? Do they have an 
unnecessary sense of panic about future conditions? In short, assessing the 
implications of responses to this section should provide valuable Insights 
about how secure each set of respondents feels and how informed they are a* jt 
major strategic elements affecting the institution. 
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Section X: External Environment 



Strongly 
Disagree 
1... 



Neither 
....3..., 



1. Major factors outside our 
institution that affect its 
enrollments have become more 
predictable over the past few 
years. 



2. Major factors outside the 
institution that affect its 
revenues have become less 
predictable aver the past few 
years. 



3, Competitive actions of other 
colleges and universities have 
become more predictable over the 
past few years. 



4. The tastes and preferences of 
students have become harder to 
forecast over the past few years. 



Strongly 
Agree 

5 




4- 
4- 
4- 



4 

4-c 
4 



4- 



+ x 



I 



D° 

+ E 



4-x 
I 
I 
I 
I 

,2.... 



Key: A-Executive Administrators D-Professional Sch Faculty 
B-Operations Administrators E-Phys&Biol Sci Faculty 
OLiberal Arts & Sci Faculty X-All Respondents 
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Section 1: External Environment (continued) 



Strongly 
disagree 
1 



5. Competitive actions of other 
colleges and universities now 
affect this institution in more 
areas (e.g., price programs 9 area 
served) than in the past. 



6. Competition with other colleges 
and universities for student 
enrollments has increased over 
the past few years. 



7. The number of potential students 
from whom our institution can 
recruit has increased over the 
past few years. 



8. Financial resources have become 
more difficult to obtain over the 
past few years. 





Key: A-Executive Administrators D-Professional Sch Faculty 
B-Operations Administrators E-Phys&Biol Sci Faculty 
C-Liberal Arts & Sci Faculty X-All Respondents 
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SECTION 2: Institutional Enrollments 



The fi--st question in this section allows you to determine whether 
consensus exists within and among the respondent groups about institutional 
enrollments over the last three years. Questions 2 through 5 focus on 
respondents' projections about future enrollments and their potential imDac 
the institution. v 



QUESTION EXPLANATION 

1. Consensus . This question asks whether total full-time equivalent 
enrollments at your institution have increased by more than five 
percent, have remained stable, or have decreased by more than five 
percent over the last three years. The ideal response pattern is for 
all the respondents in each group to select the same reply. When 
responses within a group are dispersed among the three categories, 
little consensus may exist among members of that group about the 
institution's recent enrollment experiences. Similarly, varying 
response patterns from different respondent groups Indicates little 
agreement within the institution as to its enrollment condition. 
Substantial disagreement within and among the respondent groups may 
indicate a source of contention within the Institution and a need for 
better communication about the institution's enrollment condition. 

2. Inevitability. High scores indicate that respondents predict 
declining enrollments to be inevitable in the coming year. 
Conversely, low scores reflect the perception that declining 
enrollments are not necessarily a part of the institution's near 
future. 



3. Administrative Control . High scores indicate that respondents feal 
the institution can now act to avoid the possibility of declining 
enrollments. Low scores tend to indicate a belief that future 
enrollments are largely controlled by factors external to the 
Institution. 

4. Duration. Low scores indicate a belief that an enrollment decline in 
the next year would be a short-term problem. High scores suggest 
that a near-term enrollment decline would reflect a more extended 
trend of declining enrollments. 

5. Threat . A low score indicates that respondents believe that a five 
percent decline in enrollments during the next year would threaten 
the viability of the institution. A high score suggests that 
respondents perceive the institution as resilient to the impact of a 
short-term decline in enrollments. 



Pesponses to the above questions can be interpreted in a number of ways. 
First, if there is low agreement as to whether enrollments have increased, 
remained stable, or declined, you might ask whether this indicates poor 
communication within the institution. You should also examine whether 
variations among the respondent groups, particularly faculty groups, reflect 
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differences in the respondents' experiences that are not representative of the 
whole institution. For example, if one academic unit has experienced declining 
enrollments while others have not, respondents in that unit are more likely 
than others to perceive overall institutional enrollments as decreasing. 

Second, the responses to questions 2 through 5 should be examined in 
concert. The worse-case scenario would be where respondents believe that 
declining enrollments are inevitable, that there is little the administration 
can do to prevent them, and that they will jeopardize the viability of the 
institution. Such a response pattern would indicate that respondents believe 
that the institution is about to undergo a major crisis. In this situation, 
administrators should seriously assess the extent to which plans have been 
formulated to address such a crisis and whether these plans have been credibly 
communicated throughout the institution. 
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Section 2: Institutional Enrollments 



la. To the best of your knowledge, 
full-time equivalent enrollments 
at this institution have 
increased by more than five 
percent over the past three years, 



Percent Agreement: 

2 4 6 
....0 0 0. 
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lb. To the best of your knowledge, 
full-time equivalent enrollments 
at this institution have remained 
stable over the past three 
years. 



lc. To the best of your knowledge, 
full-time equivalent enrollments 
at this institution have 
decreased by more than five 
percent over the past three years. 




Key: A-Executive Administrators D-Prof essional Sch Faculty 
B-Operations Administrators E-Phys&Biol Sci Faculty 
C-Liberal Arts & Sci Faculty X-All Respondents 
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Section 2: Institutional Enrollments (continued) 



Strongly 
Disagree 
1 2. 



Neither 
....3..., 



Strongly 
Agree 
.4 5 



2. Decreasing full-time equivalent 
enrollments are inevitable next 
year. 



3. There are actions the administra- 
tion could take now to prevent 
enrollments from declining in the 
next year. 



4. Decreasing enrollments next year 
would be indicative of a short- 
term, rather than a long-term 
problem for the institution. 



5. If enrollments were to decrease 
by more than five percent next 
year, the viability of the 
institution would be immediately 
threatened. 




Key: A-Executive Administrators D-Professional Sch Faculty 
B-Operations Administrators E-Phys&Biol Sci Faculty 
OLiberal Arts & Sci Faculty X-All Respondents 
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SECTION 3: Institutional Revenues 



The first question in this section allows you to determine whether 
consensus exists within and among the respondent groups about institution 
revenues over the last three years. Questions 2 through 5 focus on 
respondents' projections about future revenues and their impact on the 
institution. 

QUESTION EXPLANATION 

1. Consensus . This question asks whether inflation-adjusted total 
revenues at your institution have increased by more than five 
percent, have remained stable, or have decreased by more than five 
percent over the last three years. The ideal response pattern is for 
all the respondents in each group to select the same reply. When 
responses within a group are dispersed among the three categories, 
little consensus may exist among members of that group about the 
institution's recent revenue experiences. Similarly, varying 
response patterns from different respondent groups Indicates little 
agreement within the institution as to its revenue condition. 
Substantial disagreement within and among the respondent groups may 
indicate a source of contention within the Institution and a need for 
better communication about institutional revenues. 

2. Inevitability . High scores indicate that respondents predict 
declirr lg revenues to be inevitable in the coming year. Conversely, 
low scores reflect the perception that declining revenues are not 
necessarily a part of the institution's near future. 

3. Administra tive Control . High scores indicate that respondents feel 
the institution can act now to avoid the possibility of declining 
revenues. Low scores tend to indicate a belief that future revenues 
are largely controlled by factors external to the Institution. 

4. Duration. Low scores indicate a belief that a revenue decline 1n the 
next year would be a short-term problem. High scores suggest that a 
near-term revenue decline would reflect a more extended trend of 
declining revenues. 

5. Threat . A low score indicates that respondents believe that * five 
percent decline in revenues during the next year would threaten the 
viability of the institution. A high score suggests that respondents 
perceive the institution as resilient to the impact of a short-term 
decline in revenues. 

Responses to the above questions can be interpreted in a number of ways. 
First, if there is low agreement as to whether revenues have increased, 
remained stable, or decreased, you might ask whether this indicates poor 
communication within the institution. You should also examine variations among 
the respondent groups in light of the types and quality of information they are 
likely to possess about the institution's revenues. 
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8 

Second, the responses to questions 2 through 5 should be examined 1n 

■ concert. The worse-case scenario would be where respondents believe that 

■ declining revenues are Inevitable, that there U little the administration can 
do to prevent them, and that they will jeopardize the viability of the 

m Institution. Such a response pattern would Indicate that respondents believe 

0 that the Institution 1s about to undergo a major crisis. In this situation, 

administrators should seriously assess the extent to which plans have been 
m formulated to address such a crisis and whether these plans have been credibly 

■ communicated throughout the Institution. 

Finally, research at NCHEMS suggests that Individuals may be more 

■ sensitive to an Institution^ financial condition than to Its enrollment 
W experiences. You may want to compare the accuracy of perceptions about 

enrollment experiences with those concerning revenue conditions. 
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Section 3: Institutional Revenues 



Percent Agreement: 
2 4 
.0 0, 



la. To the best of your knowledge, 
inflation-adjusted total revenues 
at this institution have 
increased by more than five 
percent over the past three v^rs. 



lb. To the best of your knowledge, 
inflation-adjusted total revenues 
at this institution have remained 
stable over the past three 
years. 



lc. To the best of your knowledge, 
inflation-adjusted total revenues 
at this institution have 
decreased by more than five 
percent over the past three years. 
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Key: A-Executive Administrators D-Professional Sch Faculty 
B-Operations Administrators E"Phys&Biol Sci Faculty 
OLiberal Arts & Sci Faculty X-All Respondents 
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Section 3: Institutional Revenues (continued) 



Strongly 
Disagree 
1 2. 



Neither 
....3..., 



2. Decreasing inflation-adjusted 
total revenues are inevitable 
next year. 



3. There are actions the administra- 
tion could take now to prevent 
total revenues from declining 
in the next year. 



4. Decreasing total revenues next 
year would be indicative of a 
short-term, rather thsn a long- 
term problem for the institution. 



5. If total revenues were to decrease 
by more than five percent next 
year, the viability of the 
institution would be immediately 
threatened. 



Strongly 
Agree 
.4 5 
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X-All Bespondents 
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SECTION 4: Institutional Functioning 



Questions in ( this section focus on certain structural and process 
characteristics of your institution. Clearly identified in past research, 
these characteristics are closely correlated with the management and 
performance of an institution. Each topic is briefly explained below, and an 
indication of how to interpret high or low scores is provided. 

QUESTION EXPLANATION 



!• Specialization . High scores indicate that many specialists exist 
in the administration, while low scores indicate a preponderance of 
generalists as administrators. Large o-ganizalions are almost 
always more specialized than smaller organizations. 

2. Formalization. This question concerns the amount of formalization 
at your institution. Formalized institutions are governed by an 
abundance of rules and regulations. Institutions that score low on 
this item can be characterized as more informal and flexible. 

,6. Mission . These four items assess perceptions of institutional 

mission. Institutions that score high on one of these items tend 
to score high on all four, while those that score low on one tend 
to score low on all four. High scores Indicate that the 
institution has a special sense of identity and mission, and that 
respondents feel that a special purpose is associated with the 
school. Low scores indicate that the institution is not much 
different from many other schools, and that respondents hold 
diverse views regarding its purpose. 

7 « Investor Confidence . High scores indicate that the institution 
provides substantial benefit to constituencies who invest time or 
resources in it. Low scores indicate that the school may not be 
providing constituencies with what they want. 

8. Structural Coupling . High scores indicate that elements of 
institutional structure are loosely coupled. That is, the 
institution has many autonomous subunits that can operate 
independently of each other. Low scores indicate tighter coupling 
and closer coordination among subunits. 

9. Centralization. High scores indicate that major decisions tend to 
be made at the top of the organizational hierarchy. Low scores 
reflect broad participation by members at lower levels of the 
organization. 

10. Planning . High scores indicate that a short-term planning 

perspective is perceived to permeate the institution. Low scores 
indicate that a long-term perspective is more typical. 
Institutions facing crises or uncertainty frequently adopt a 
short-term perspective. 
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Innovation . High scores Indicate that innovations and 
experimentation are increasing. Low scores indicate a decrease in 
innovation. 

Scapegoating . This question measures the extent to which top 
administrators are scapegoated or blamed for problems in the 
institution. High scores indicate that respondents feel that 
administrators get more than their share of blame. Low scores 
indicate that administrators are not perceived as carrying the 
brunt cf criticism. 

Resistance to Change . This item reflects the extent to which 
resistance to change and innovation is present in the institution. 
High scores reflect conservative tendencies. Low scores indicate a 
willingness to try new things and to accept change. 

Administrative Turnover . High scores indicate thct respondents 
perceive a large amount of turnover in administrative positions, 
even instability. Low scores indicate little turnover and a great 
deal of stability. 9 

Morale. High scores indicate that respondents feel morale is 
improving. Low scores indicate that morale is decreasing and that 
people are becoming more dissatisfied. 

Slack Resources . This question measures the amount of slack or 
uncommitted resources present in the institution. High scores 
indicate that the institution has few discretionary resources and 
that cuts would damage the school. Low scores indicate that the 
institution is perceived to have resources that could be 
reallocated or cut without "getting to the bone." 

Interest Groups . This item reflects the extent to which special 
interest groups are becoming more visible and verbal. Under 
conditions of crisis or threat, groups often organize and become 
more politically active. They put greater demands on the 
institution to respond to their preferences. High scores indicate 
that the institution is becoming more political and pluralistic; 
low scores indicate the reverse. 

Administrator Credibility . High scores indicate that respondents 
have confidence in the Integrity of top administrators. Low scores 
indicate that top administrators are seen as untrustworthy or 
incompetent. 

Reallocation Priorities . This question concerns whether cutbacks 
occur on the basis of priority or are initiated across-the-board. 
High scores indicate the presence of a prioritized plan for 
retrenchment. Low scores indicate a tendency toward generalized, 
across-the-board cutbacks. 

Conflict . High scores indicate increasing conflict among 
institution members, while low scores reflect a decrease in 
conflict. 
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21 • Locus of Control . This item assesses where top administrators 

place their locus of control. People are said to have an internal 
locus of control when they view the world as a place they can 
control, or where they can influence causal factors. People are 
said to have an external locus of control when they view the world 
as largely beyond their control. Uncontrollable events play a 
significant role for them. High scores on this item indicate that 
top administrators are externally oriented; they feel that factors 
affecting the institution and lie outside the institution cannot be 
controlled. Low scores indicate an internal locus of control and 
the feeling that top administrators can control the destiny of the 
school . 

22. Internal Mobility . High scores indicate that top positions are 
generally filled through promotion from within the institution. 
Low scores indicate that top positions are more likely to be filled 
by people from outside the institution. 

Once you have reviewed individual scores, consider them as a group. By 
taking note of especially high and low scores, you can put together descriptive 
sentences such as, M We see ourselves as having a very clear consensus regarding 
our mission and a strong resistance to change. People generally feel good 
about participating in the institution (high investor confidence and rising 
morale). Decisionmaking is seen as highly centralized. Resources are very 
scarce, yet people tend not to blame administrators for problems." Through 
such an exercise, you can begin to paint a picture of how people view your 
institution. 

Also consider what might lie behind any apparent incongruities. For 
example, some institutions score high on resistance to change and on 
innovation. Some find that morale is rising, in spite of the apparently 
contradictory fact that conflict is perceived to be high. Are such 
incongruities explained by looking closely at differences among groups of 
respondents? Was there a key issue on campus at the time they completed the 
surveys that may have colored their responses? 

You can also use the responses collectively to probe fundamental issues 
about why people at your institution seem to see things as they do. In the 
example above, you may be surprised that an institution where people are 
basically content can also be one with high centralization and scarce 
resources. Ask yourself whether you believe that the scores represent reality. 
If you have confidence in them, consider the factors that may account for them. 
Perhaps that institution has a strong president who has an excellent grasp of 
what people want done. Centralization gets them what they want without their 
taking time or effort to ensure it. If such president is nearing retirement, 
what kind of president is now needed and what possible changes should be made 
in habitual patterns of decisionmaking? 
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Section 4: Institutional Characteristics 



Strongly 
Disagree 
1 ...2 



1* This institution has many 
administrators performing 
specialized functions. 



2. Formal policies and rules govern 
most activities at this 
institution. 



3. This institution has a special 
identity, unlike any other in 
higher education. 



4. There is a general sense that 

this institution has a distinctive 
purpose to fulfill. 




Key: A-Executive Administrators D*Prof eseional Sch Faculty 
B-Operations Administrators E-Phys&Biol Sci Faculty 
C-Liberal Arts & Sci Faculty X-All Respondents 
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Section 4: Institutional Characteristics (continued) 



Strongly 
Disagree 
1 



Neither 
....3.... 



5. The academic piograms offered 
here reflect the mission of 
the institution. 



6. People associated with this 
institution share a common 
definition of its mission. 



7. Those who make a personal or 
financial investment in this 
institution believe that they 
receive an ample return. 



8. The activities of the various 
units in this institution are 
loosely-coordinated or loosely- 
coupled. 
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Section 4: Institutional Characteristics (continued) 



Strongly 
Disagree 
1 2. 



Neither 
....3..,. 



9. Major decisions are very 
centralized. 



10. Long-term planning is neglected. 



11. Innovative activity is increasing. 



12. Top administrators are often 
scape goats. 
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Section 4: 



Institutional Characteristics 



(continued) 



Strongly 
Disagree 

1 2 



13. There is a lot of resistance to 
change in this school. 



14. There is a great deal of turnover 
in administrative positions. 




15. Morale is increasing among members 
of this institution. 



16. We have no place that we could cut 
expenditures without severely 
damaging the school. 
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Section 4: Institutional Characteristics (continued) 



Strongly 
Disagree 
1 



Neither 
....3..., 



17. Special interest groups within 
the institution are becoming 
more vocal. 



18. Top administrators have high 
credibility. 



19. When cutbacks occur, they are 
done on a prioritized basis. 



20. Conflict is increasing within 
this institution. 



Strongly 
Agree 
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Section 4: Institutional Characteristics (continued) 



21. Top administrators believe that 
factors outside the institution 
largely determine its condition. 



22. Top administrative positions are 
now held by individuals who were 
promoted from within the 
institution. 



Strongly 
Disagree 
1 ,2. 
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SECTION 5: Institutional Culture 



This section concerns the kind of culture that exists 1n your Institution. 
An Institution's culture can be categorized as one cf four types: a clan 
culture, a hierarchy culture, a market culture, and an emergent- system culture. 
Some Institutions have a single dominant culture; others have a more 
heterogeneous culture that cannot be characterized as any one type. This 
section of the questionnaire assesses both the extent to which a dominant 
culture exists and the type of culture that pervades the Institution. 

Each type of culture has certain characteristics, among them leadership 
style and certain strategic orientations. The four items Included In this 
section assess the extent to which the characteristics of one culture are 
consistently present within your Institution or whether a diverse culture 
exists. The following provides a brief explanation of the four cultures and 
their salient characteristics. 

CULTURE CHARACTERISTICS 

cl « n A clan 1s much like a family; 1t 1s highly personal and 

formal. Loyalty and tradition are bonding forces and morale 
Is usually high. Clans are usually led by father or mother 
figures or by mentors. 

Emergent System An emergent system 1s dynamic and entrepreneurial; 1t 

emphasizes Innovation and new Ideas. This kind of Institution 
1s strongly committed to development and progress, and Its 
leader 1s usually an Innovator or entrepreneur. 

A hierarchy 1s a formalized, tightly structured Institution 
governed by formal rules and procedures. As archetypal 
bureaucracies, such institutions emphasize efficient, 
well-oiled processes. They value stability and permanence. 
Hierarchies are usually led by organizers and coordinators. 

When a market culture pervades an Institution, the school Is 
production-oriented and values the accomplishment of tasks. 
Goals drive the Institution's activities, and there 1s a sense 
of competition and achievement among members. The leader of a 
market-oriented Institution 1s usually a hard-driving producer 
who places high priority on results. 

For each of the four topics included 1n this section, respondents were 
asked to divide 100 points among the four types of cultures, indicating how 
well each type described your institution. The first topic concerns which 
specific culture, if any, prevails at your institution. The second topic 
focuses on institutional leadership, the third looks at institutional cohesion, 
and the fourth describes institutional emphases. Throughout, item A represents 
the clan type of institution; item B portrays the emergent system; item C 
represents the hierarchical institution; and item D 1s indicative of a 
market-oriented institution. Schools with congruent cultures score 



Hierarchy 



Market 
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consistently high on the same cultural type in each of the four topics. 
Schools with heterogeneous cultures have no consistent pattern to their scores. 

Approximately 50 percent of the four-year institutions we studied have a 
congruent culture, whereas the remaining 50 percent have a diverse or 
heterogeneous culture. Our research has shown that approximately 40 percent of 
all schools have a clan culture, about 5 percent have a hierarchy culture, 
about 3 percent have an emergent-system culture, and about 1 percent have a 
market culture. 

Preliminary analyses of data for over 300 four-year institutions show that 
private institutions tend to have a much stronger clan-like culture than 
institutions in the public sector. However, this relationship appears to be 
moderated by institutional size. Smaller institutions are much more likely to 
be perceived as having a clan culture than larger institutions. Correlational 
analyses show that each cultural type has a different pattern of relationships 

?h« a a ^?^?L!h- ect K d ] n stitut1oral processes. The table belo* summarizes 
these relationships by indicating the direction of the relationship between the 
cultural types and each of the selected aspects of institution functioning and 
performance. For example, the first row indicates that clan and emergent 
cultures have a positive relationship with investor confidence while hierarchy 
and market cultures are negatively related to investor confidence. That is, 
the more an institution is like a clan or emergent system, the more likely that 
investor confidence is high. Conversely, the more an Institution 1s like a 
hierarchy or market, the more likely investor confidence 1s low. Examining the 
table in light of your own institution's scores can provide you with some 
Insight into how your institution's cultural orientation might be related to 
Institutional functioning. 

Cultural Type 

Variables Clan Emergent Hierarchy Market 

Investor Confidence + + _ 

Centralized Decisionmaking - + + 

Long Term Planning - + + 

Innovative Activity - + + 



Morale + + 

Administrative Credibility + + 
Conflict 

Student-Faculty Relations + 

Equity of Rewards + + 

Trust Among People + + 

Feedback + + 
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Section 5: Institutional Culture: Type 



Percent Agreement: 

2 4 6 
....0 0 0. 



1A. This institution is a very 

personal place. It is like an 
extended family. People seem to 
share a lot of themselves. 



IB. This institution is a very 

dynamic and entrepreneurial place. 
People are willing to stick 
their necks out and take risks. 



1C. This institution is a very 

formalized and structured place. 
Bureaucratic procedures generally 
govern what people do. 



ID. This institution is very 

production oriented. A major 
concern is with getting the job 
done. People aren't very 
personally involved. 
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Section 5: Institutional Culture: Leader 



Percent Agreement: 
2 4 
.0 0, 



2A. The head of this institution it, 
generally considered to be a 
mentor, a sage, or a father or 
mother figure. 



2B. The head of this institution is 
generally considered to be an 
entrepreneur , an innovator, or a 
risk taker. 



2C. The head of this institution is 
generally considered to be a 
coordinator, an orgauizer, or 
ar: administrator. 



2D. The head of this institution is 
generally considered to be a 
producer, a technician, or a 
hard-driver. 




A-Executive Administrators D«Professional Sch Faculty 
B-Operations Administrators E«Phys&Biol Sci Faculty 
C-Liberal Arts & Sci Faculty X«All Respondents 
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Section 5: Institutional Culture: Cohesion 



3A. The glue that holds this 

institution together is loyalty 
and tradition. Commitment to 
this school runs high. 



3B. xhe glue that holds this 
institution together is a 
commitment to innovation and 
development. There is an 
emphasis on being first. 



3C. The glue that holds this 

institution together is formal 
rules and policies. Maintaining 
a smooth-running institution is 
important here. 



3D. The glue that holds this 
institution together is t*e 
emphasis on tasks and goal 
accomplishment. A production 
orientation is commonly shared. 



Percent Agreement: 

2 4 6 
....0 0 0. 
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Section 5: Institutional Culture: Emphases 



Percent Agreement: 

2 4 6 
....0 0 0. 



4*. This institution emphasizes human 
resources. High cohesion and 
morale in the school are 
important. 



4B. This institution emphasizes growth 
and acquiring new resources. 
Readiness to meet new challenges 
is important. 



4C. This institution emphasizes 
permanence and stability. 
Efficient, smooth operations 
are important. 



4D. This institution emphasizes 
competitive actions and 
achievement. Measurable 
goals are impurtant. 
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SECTION 6: Institutional Strategy 



Questions in this section on institutional strategy deal with the nature 
and extent of recent changes in your institution. Such changes are generally 
thought to be necessary when adapting your organization to a changing 
environment, thereby enabling it to develop. Research has shown that optimal 
responses to these questions vary for each institution, depending on its 
history, capabilities, and environment. 

Question Explanation 

1,2. Diversity . These two questions concern whether your institution is 
becoming more or less diverse in terms of its program offerings and 
student body. Both increased and decreased diversity are viable 
means of dealing with an organization's environment. Diversity 
spreads the risk of decline. Although one program or client group 
may shrink, another may expand— leaving the institution as a whole in 
approximately the same condition. Reduced diversity, or 
specialization, is appropriate when a clear need exists for a 
particular kind of program or for services to a specific client 
group. An institution specializing in that area can tap that market, 
rendering the school more attractive than one trying to include that 
market among many others. 

4.7. Conservatism . High scores on these i 4 uestions indicate a conservative 
orientation toward institutional strategy. Taking certain 
conservative measures is generally recommended, even 1f the 
institution is simultaneously taking more aggressive strategic 
action. One purpose of these conservative measures 1s to build 
political slack or credibility with external constituents and thereby 
buffer the organization from conflicting demands for change. Another 
purpose is to ensure that existing competencies of the Institution 
remain strong and competitive. 

5.8. Moderate Change . High scores on these quest, ns indicate an 
organization that makes major strategic changes but in a conservative 
way. Such an institution will study the effects of similar changes 
on other organizations, nr will do more of what the institution 
already does well. 

6.9. Innovation . Institution: showing greatest change score h'ghest on 
these questions. They are the first to try new things, and they 
establish new domains of activity. Optimal responses to these 
questions, and to the others in this section, depend heavily on the 
nature of the institution's mission and on events ? 1 trends in its 
environment. 

3,10, Administration . This set of six questions deals with your 
11.12, institution's administration. Is your college or v livers ity 
13,14. attempting to monitor and respond to its environment? Is 

it increasing the quality of its administrators? When it comes to 
financial strategies, is your institution attempting to attract new 
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sources of revenue or to use existing revenue more efficiently? Are 
decisionmaking processes enhanced by attention to multi-year 
strategies and by feedback about past and current strategies? Our 
research has indicated that this set of questions contains more 
normative implications that the first four sets. That 1s, 
institutions that rate themselves highly on such factors as morale, 
student development, and ability to acquire resources also tend to 
rate themselves highly on this set of questions. 

Again, it mikes sense to examine strong responses in this section by, in 
effect, writing a paragraph about the school. For example, "Our college is 
diversifying its programs in highly innovative ways, but continuing to serve 
its traditional clientele. We are engaging in a good deal of management 
activities such as revenue attraction, revenue efficiency, and multi-year 
strategies, but the professionalism of ou managers may be deteriorating." You 
may also want to incorporate responses from other sections to build a more 
complete picture of the school. The exercise enables you to find: 

• Paradoxes— How can we be perceived as conservative ana innovative at the 
same time? 

• Potential problems— We're relying heavily on managerial responses, yet 
-he quality of our managers is deteriorating 

• Clear signals—Every question on mission shows that we all understand 
why we're here. 

It appears that situations today are so complex as to require strong, 
multiple, and diverse strategies. We have found a number of schools that seem 
to be doing well by, in effect, scoring high on an the dimensions 1n this 
section. Properly focused and channeled, each dimension can have value. 
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Section 6: Institutional Strategy 



Strongly 
Disagree 
1... 2. 



Neither 
....3.... 



1* We are making our academic 
programs more diverse. 



2. We are changing the composition 
of our student body, making it 
more diverse. 



3. We are increasing the investment 
of the college in functions that 
deal with external people 
(admissions, development, 
government relations, and others). 



4. This institution tries to 

insulate itself from pressures 
in the environment. 
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Section 6: Institutional Strategy (continued) 



Strongly 
Disagree 
1 2. 



5. This institution tries new 

activities or policies, but not 
until after others have fouud 
them successful. 



6. This institution is likely to be 
the first to try new activities 
or policies. 



7. Our top administrators educate 
important outsiders about the 
value of the institution in order 
to improve its legitimacy in 
their eyes. 



8. This institution tends to do 
more of what it does well, to 
expand in areas we have expertise. 
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Section 6: Institutional Strategy (continued) 



Strongly 
Disagree 
1 2. 



Neither 
....3.... 



Strongly 
Agree 



9. This institution establishes new 
domains of activity. 



10. We are increasing the quality 
of the individuals in top 
administrative positions. 



11. Top administrators emphasize 
finding new money, more so than 
saving money, for a balanced 
budget. 



12. The top administrative team has 
developed multi-year strategies 
to achieve long-term institutional 
objectives. 
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Section 6: Institutional Strategy (continued) 



Strongly 
Disagree 
1 2. 



Neither 
...•3..*, 



Strongly 
Agree 
.4 5 



13. The top administrative team 
receives rapid and accurate 
feedback about enrollment and 
financial conditions. 



14. The top administrative team 

provides incentives for conserving 
resources. 
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SECTION 7: Resource Allocation 



Resource allocation in colleges and universities often elicits interest 
and concern. People want m«re resources for the projects th?,v believe in. 
Failing that, they wish to protect their favorite projects from resource 
reduction. Sometimes they believe that resources are distributed fairly and 
sensibly; at other times they do not. When the latter is tru«>, morale can 
decline. Moreover, people tend to perceive the resource-allocation process 
differently. Lieir views depend upon such factors as how closely they are able 
to observe its inner workings or how well allocation decisions match their 
Dersonal priorities. Therefore, we often find interesting variations among 
replies to the following questions. When one group of respondents differs from 
others, you should consider why this may be the case. You may also wish to ask 
those involved to explain their views more fully than is permitted in a survey. 

Question Explanation 

1.7. Bureaucratic Allocation . Both of these questions concern how 

bureaucratic your resource-allocation decisions are. High scores on 
question 1 indicate a highly standard, routine, or regular 
resource-allocation process. People may not know what a specific 
decision is going to be, but they are likely to know when 1t was 
proposed, how it has been examined, who will make the decision, and 
when it will occur. Low scores suggest a very unpredictable, 
irregular decision process. Question 7 explicitly deals with the 
perceived amount of bureaucracy in the decision process Question 7 
is not highly correlated with question 1. This suggests that 
respondents consider factors other than standardization in their 
definitions of bureaucracy, among them ridigity of organizational 
structure, hierarchy, centralization of control, and predictability 
of results. 



2.8. Autocratic Allocation . Questions 2 and 8 identify whether the. 
decision process Is autocratic, with the outcome essentially 
determined by a single individual. The questions are highly 
correlated and should produce similar responses. High scores suggest 
that people believe resource-allocation decisions are made entirely 
by one person; low scores imply wide participation. 

3.9. Collegia! Allocation . Both of these questions identify whether the 
decision process 1s collegial. The questions are highly correlated, 
so responses are likely to be very similar. High scores suggest that 
resource allocation is a matter for collegial discussion and 
consensus-building; low scores imply limited participation. 

4,10. Rational Allocation . Questions 4 and 10 ask whether the 

resource-allocation process is rational. Question 10 concerns one 
aspect of the rational process, objectively matching resources with 
the needs of the institution. Again, the two questions are highly 
correlated. High scores suggest that respondents believe resources 
are being well-matched with institutional priorities and that 
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decisions are made in a sensible manner. Low scores imply a random, 
arbitrary, and unpredictable process. 



5.11. Allocation as Organized Anarchy . These two questions deal with a 
decision process that has been called organized anarchy. High scores 
suggest a very unpredictable, irregular decision process. 
Individuals may have difficulty determining how they could 
participate or what might result if they tried to participate. 
Question 11 implies even more chaos in the decision process. High 
scores on question 11 suggest that picking numbers out of a *-at could 
approximate the results of the resource-allocation process. As might 
be expected, few institutions have high scores on this question. 

6.12. Political Allocation . Questions 6 and 12 relate to a political 
decision process, but the two are not highly correlated. Question 6 
focuses on the use of power and the imposition of decisions based on 
relative political strength. Question 12 concerns a more 
conciliatory negotiating style in which each party obtains some 
portion of what it wants. Most resource-allocation processes 
demonstrate some of these political characteristics, but they may or 
may not constitute the dominant mode of decisionmaking at your 
institution. 

You can view the results from this section in three ways. First, examine 
the responses to each pair of questions listed above. Consider how high or low 
the responses are in that area and what respondents may have meant by their 
answers. Second, compare the pairs with one another to develop a rough 
rank-ordering of decision types on your campus. You might find, for example, 
that your resource-allocation process is seen as predominantly rational, with a 
strong political component and an element of bureaucratization. Third, examinp 
whether answers vary among different categories of respondents. Do faculty 
members and administrators see the process in similar terms? If not, 
administrators may be perceiving their intended process instead of the real 
one. They also may not have adequately communicated the real process to the 
faculty. 

Elenents of several processes are used in most institutions. The 
structure of the process is often bureaucratic, with the same procedures being 
followed faitnfully every year. Political negotiations are almost always 
present in the process, yet most Institutional members may believe that 
allocations are objectively best for the institution as a whole. The responses 
to this section can be used as the basis of an analysis of your own allocation 
process. Which parts of the process fit which models? How are spending 
proposals generated? What happens when it becomes clear that some budgets must 
be cut? The resulting analysis can prove helpful in defining why some parts of 
the process may be working well and others not. 
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Section 7: Resource Allocation 



Strongly 
Disagree 
1 2, 



Neither 
....3..., 



1. This institution has a standard 
set of procedures it uses to make 
resource allocation decisions. 



2. One individual at this institution 
makes all resource allocation 
decisions of any consequence. 



3. People at this institution make 
resource allocation decisions 
collegially . 



4, A rational process is used to 

make resource allocation decisions 
at this institution. 
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Agree 
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Section 7: Resource Allocation (continued) 



Strongly 
Disagree 

1 2, 



Neither 
....3..., 



5. No particular pattern 

characterizes the process by 
which resource allocation 
decisions are made here. 



6. Resource allocation decisions are 
political, based on the relative 
power of these involved. 



7. Resource allocation is decided 
bureaucratically at this 
institution. 



8. Resource allocation is decided 
autocratically. 
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B 

C 

E 

X 



D 
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+B 
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4- 
I 

I 
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-+- 



-+- 
4- 

4- 
4- 



+ B 

-I c 



I 
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I 

4 x 

I 
I 
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I 
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Key: A"Executive Administrators 
B B Operations Administrators 
C-Liberal Arts & Sci Faculty 



D-Professional Sch Faculty 
E-Phys&Biol Sci Fsculty 
X-All Respondents 
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Section 7: Resource Allocation (continued) 



Strongly 
Disagree 
1 2. 



Neither 
....3.... 



9. Resource allocation is a matter 
for group discussion and 
consensus. 



10. Resource allocation decisions are 
based on what objectively seems 
best for this institution overall. 



11. Resource allocation is decided by 
coincidence; it is a matter of 
organized anarchy. 



12. Persuasion, negotiation, and 
coalition-building are examples 
of what determines resource 
allocation. 



I 



Strongly 
Agree 
.4 5 



—D 



+-A 

+B 

+C 

I 

|~X 



I 
I 
I 
I 

+c B 
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I 
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Key: A-Executive Administrators 
B-Operations Administrators 
C-Liberal Arts & Sci Faculty 



D-Professional Sch Faculty 
E-Phys&Biol Sci Faculty 
X«A11 Respondents 
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SECTION 8: Institutional Effectiveness 




The items in this section measure nine dimensions of institutional 
effectiveness. These questions were developed through a series of interviews 
in which top administrators, faculty department heads, and trustees were asked 
to identify characteristics associated with highly effective colleges and 
universities. They answered such questions as what would have to be done to 
Improve the effectiveness of their own institution, what were the 
characteristics of the most effective colleae thev knew of and what factors in 
their own institution most affect its performance. From their responses a 
large number of criteria emerged regarding effectiveness. In turn, questions 
were constructed to assess those criteria. The questions have been used since 
1975 in research on colleges and universities- They have been developed to the 
point where we have confidence that they measure institutional effectiveness in 
a valid and reliable way, if not the only good way. 




The questionnaire Items have been found to cluster into nine different 
groupings. These nine dimensions are briefly explained below. 


1 


DIMENSION 


EXPLANATION 


1 


Student 

Educational 

Satisfaction 


Indicators focus on student, satisfaction 
with their educational experiences at the 
institution. 


1 


Student Academic 
Development 


Indicators focus on the extent to which the 
institution provides opportunities for student 
academic development. 




Student Career 
Development 


Indicators focus on the extent of vocational and 
occupational development among students and the 
opportunities for career training provided by 
the institution. 


J 


Student Personal 
Development 


Indicators focus on the extent of nonacademic, 
noncareer development— for example, cultural, 
emotional, and social development— and the 
opportunities for and emphasis placed on personal 
development by the institution. 


1 


Faculty and 
Administrator 
Employment 
Satisfaction 


Indicators focus on the satisfaction of faculty 
members and administrators with their employment. 


! 


Professional 
Development 
and Quality of 
the Faculty 


Indicators focus on the extent of professional 
attainment and development of the faculty and the 
emphasis and opportunities for professional 
development provided by the Institution. 
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System Openness 
and Community 
Interaction 



Indicators focus on the extent of Interaction 
with, adaptation to, and service for 
constituencies 1n the external environment. 



Ability to 

Acquire 

Resources 



Indicators focus on the ability of the 
Institution to acquire resources, such as 
good students, desired faculty, financial 
backing, and political support. 



Organizational 
Health 



Indicators focus on the vitality and 
benevolence of internal processes in the 
institution, such as. openness and trust, the 
ability to solve problems, and the willingness 
to share information. 



Research on a large number of four-year colleges and universities has 
shown that no institution . -ores high on all nine dimensions of effectiveness. 
Trade-offs are made by all institutions. The best way to interpret this 
information is to compare how you think your school ought to score, given its 
mission, with how it actually did score. Are the relative strengths and 
weaknesses indicated by the profile of the nine dimensions insistent with your 
preferences? Even though your school may be weak on some dimensions, they may 
be less important to you than those in which the institution does especially 
well. Therefore, the usefulness of your scores lies in determining whether 
your institution is highly effective in those areas 1n which you prefer 1t to 
be effective. 
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Section 8: Institutional Effectiveness 



Low 
1... 



Medium 
....3... 



1. Student Educational Satisfaction: 
The degree to which students are 
satisfied with "heir educational 
experiences at the institution. 



2. Student Academic Development: 

The degree of academic attainment, 
growth, and progress of students 
and the academic opportunities 
provided by the institution. 



3. Student Career Development: 
The degree of occupational 
development of students and tne 
emphasis and opportunities for 
career development provided by 
the institution. 



High 
....5 



D 



4— 

4-c 
I 

H — 



+B 

I 



-A 



— X 



I 
I 



—A 



E 



— D 



I 
I 
I 
I 

.2. 



4 



H — B 



Key: A-Executive Administrators 
B-Operations Administrators 
C-Liberal Arts & Sci Faculty 



D-Professional Sch Faculty 
E-Phys&Biol Sci Faculty 
X-All Respondents 
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Section 8: Institutional Effectiveness (continued) 



4. Student Personal Development: 
The degree of nonacademic, 
noncareer development 
(e.g., culturally, socially) and 
the emphasis and opportunities 
for personal development 
provided by the institution. 



5. Faculty and Administrator 
Employment Satisfaction: The 
satisfaction of faculty members 
and administrators with their 
employment. 



Low 
1... 



Medium 
....3... 



6. Professional Development and 
Quality of the Faculty: The 
degree of professional attainment 
and development of the faculty 
and the emphasis and opportunities 
for professional development 
provided by the institution. 



High 
....5 



-I A 

J. + B 

— + C | 

— + + D 

— + • +-E 
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H c I 
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Key: A«Executive Administrators 
B-Operations Administrators 
OLiberal Arts & Sci Faculty 



D-Professional Sch Faculty 
E-Phys&Biol Sci Faculty 
X«A11 Respondents 
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Section 8: Institutional Effectiveness (continued) 



Low 
1... 



Medium 
....3... 



7. System Openness and Community 
Interaction: The emphasis placed 
on interaction with, adaption to, 
and service in the external 
environment. 



8. Ability to Acquire Resources: 
The ability of the institution to 
acquire resources such as good 
students and faculty and financial 
support. 



9. Organizational Health: 

The vitality and benevolence ^f 
the internal processes in the 
institution such as openness and 
trust, problem solving adequacy, 
shared information, etc. 



High 
....5 



H A 

-+ B 



C 



I 
I 

-+-A 
— B 



— +D 
— +E 
(-X 

I 

I 

I 



~C 
— D 



-X 
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c| 

— D | 
+E 



Key: A-Executive Administrators D-Professional Sch Faculty 
B-Operations Administrators E»Phys&Biol Sci Faculty 
C-Liberal Arts & Sci Faculty X-All Respondents 
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APPENDIX 

Institutional Performanc, Survey Instrument 
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Institutional 
Performance 
Survey 



PODS5S T f ° r H ' flher EdUCat,0n Ma "»fl«™t Systems 
RO. Drawer P Boulder. co J 0302 
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Dear Respondent- 



ia iSS l l Part ° f an assess ™* your institution is undertaking with 

tKS?™* ? ^ Nati0nal Center for Hi 9 her Education Manage^mSyrtems 
^ SfTnd 2 de , Si9 ^ d !° P r0Vlde inf0rmati0n on Percept^ of 
55^225^ — 1 lnStitUti0n ^ Mahout any £ 

The response of all Individuals completing the survey will be held in ih. .r rw«. 
confidence. The data will be analyzed at NCHc5STn kSj&^KS 

wodd lISTS^ th * < uestionn » ire "'liest convenience. If possible, we 

would like the questionnaire returned within one week of when vouVeiwit 
^ous respondents have taken 20 to 30 minutes to complete Seq~esSre 

h ° Pe th "' y ° U flnd ^ es,ions interestSmJugh': 
provoking. If you have any questions or comments, please feel free to contact 
Dr^ay Zammu.o or Dr. Jack Krakower a, (303) 497-0388. Thank^o^ 
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SECTION 2: Institutional Enrollments! 



This section Is concerned with your institution's enrollment experiences over th* ».» 
few yeers, and with what you think Is likely to ^m^S^^StS^ 

h Eve* ° f y ° Ur knOW,edfle ' fu,IUme enrollments at this institution 

(1) Increase* by more than five percent over the past three years 

(2) Remained stable over the past three years 

(3) Decreased by more than five percent over the past three years 

^t^SiS!!^^ y0U i° *P ecu,rte •** institutional enrollments for the 
JS! £ieSoT to the rlflht of each .utement that best reflecS 

2. Decreasing full-time equivalent enrollments are inevitable next year. 

3 ' £Sn£ Si: intof,,ten toke ~ to enroHmenU from 




i SECTION 1: Changes in the Institution's External Environment 

teW^?^™™'^ condlUon, outside your Institution over 
•~t^^ each statement that 

1 • ssaras^ csr ^ affect to ■« 

2 ^^er^ei^r ^ affect * ^ - 

3 - 2SS^J?S? * ,° ther eoBefles and un ^« have become more 
preoictawe over the past few years. 

4. The tastes and preferences of students have become harder to forecast over the 
past few years. 

5. Competitive actions of other colleges and universities now affect this institution in 
more areas (e.g.. price, programs, area served) than in the past. 

6 ' SS" 1 "ill 0 **', and unl ™*'ties for student enrollments has 
increased over the past few years. 

7 'Hl nU J? ber 0f L pOtentW * tudents from *hom our institution can recruit has 
increased over the past few years. 

8. Financial resources have become more difficult to obtain over the past few years. 
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-15 



-16 



-17 



-10 



-19 



-20 
-21 



-23 



-24 
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-27 
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SECTION 3: Institutional Revenues 



This section is concerned with your Institution's revenue experiences over the pest 
few years, and whet you think is likely to happen to total revenues next year. 

1. To the best of your knowledge, inflation-adjusted total revenues at this institution 
nave 



. (1) Increased by more than five percent ever the past three years 
. (2) Remained stable over the past three years 
(3) Decreased by more than five percent over the past three years 



year. 



The following questions ask you to speculate about Institutional revenues for the next 
Jtews **** nUmber l ° ther, fl htofe ^ h statement that best reflects your 

2. Decreasing inflation-adjusted tof^l revenues are inevitable next 

3. There are actions the administration could take now to prevent total revenues from 
declining in the next year. 

4. Decreasing total revenues next year would be indicative of a short-term, rather 
man a long-term, problem for the institution. 

5. If total revenues were to decrease by more than five percent next year, the viability 
of the institution would be immediately threatened. 



-» 
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3 
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-30 



-31 



-32 



1 SECTION 4: Institutional Characteristics 



In this section, we are asking for your Impressions of some general characteristics 
of your institution. Please answer each item. If you are not sure, make your best 
i guess. 

1. This institution has many administrators performing specialized functions. 

2. Formal policies and rules govern most activities at this institution. 

3. This institution has a special identity unlike any other in higher education. 

4. There is a general sense that this institution has a distinctive purpose to fulfill. 

5. The academic programs offered here reflect the mis Jon of the institution. 

6. People associated with this institution share a common definition of its mission. 

7. Those who make a personal or financial investment in this institution believe that 
they receive an ample return. 

8 ' co^pted^ 1 " ° f V8ri0US " nitS ln thi$ institution are loose, y coordinated or loosely 
9. Major decisions are very centralized. 
10. Long-term planning is neglected. 
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Institutional Characteristics (continued) as 



1 1 . Innovative activity is increasing. 

12. Top administrators are often scape goats. 

13. There is a lot of resistance to change in this school. 

14. There is a great deal of turnover in administrative positions. 

15. Morale is increasing among members of this institution. 

16. Wehave no place that we could cut expenditures without severely damaging the 

17. Special interest groups within the institution are becoming more vocal. 

18. Top administrators have high credibility. 

19. When cutbacks occur, they are done on a prioritized basis. 

20. Conflict is increasing within this institution. 

2 ' ' b "* ,e *" 0utti * "* "» ti "" i °" determine «s 

l22 - irnTS^r*' 005 " e now "* by individusb » h ° — *-» 
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i SECTION 5. Type of Institution 

Jlon, depend'.* on how stall., the descnpttM iSool £?f^f • mon « "* *""P- 

f* ..her,; *c. , re Just different. For JJ " ■» »— ■«« 

TO/? EXAMPLE: 

111 question 1 , If institution A seems very similar to mint" B seems somewhat similar «t r.»tn 
do no. s«m similar a, .11. , might „ive 70 points to A and 30 pSS ?B Sn<1 ° 



I 
I 



t 
I 



InsUtuUonal Characteristics (Please distribute 100 points) 
Institution A is a very personal place. It is like 
an extended family. People seem to share a lot 
of themselves. 

— [ nst *ution C is a very formalized and struc- 
tured place. Bureaucratic procedures gen- 
erally govern what people do. 



points 
for B 



points 
for D 



. Institution B is a very dynamic and entrepre- 
neunal place. People are willing to stick their 
necks out and take risks. 

Institution D is very production oriented. A 
major concern * with getting the job done. 
People aren't very personally involved. 



Fnts 
C 



InsUtuUonal Leader (Please distribute 100 points) 

The head of institution A is generally consid 
ered to be a mentor, a sage, or a father or 
mother figure. 

The head of institution C is generally consid- 
ered to be * coordinator, an organizer, or an 
administrator. 



fnts 
A 



The head of institution B is generally consid 

pwm, ered t0 ^ an entrepreneur, an innovator, or 
rof B a risk taker. 

The head of institution D is generally consid 
ered to be a producer, a technician, or a hard- 
driver. 
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-55 



-57 56 
5*60 
•1-62 
1344 



IerJc 



points 
for D 

53 



-45-66 
67 66 
t*70 

7172 



202 



I 

I 



Type of Institution (continued)! 



3. Institutional "Glue" (Please distribute 100 points) 

The glue that holds institution A together is 
loyalty and tradition. Commitment to this 

I WA school runs high. 
The glue that holds institution C together is 

formal rules and policies. Maintaining a 
smooth-running institution is important here. 



points 
i for A 



I 



points 
forC 



The glue that holds institution B together is a 
commitment to innovation and develop- 
ment There is an emphasis on being first. 

The glue that holds institution D together is the 
emphasis on tasks and goal accomplishment. "n n 

A production orientation is commonly shared. £2 



points 
for B 



points 
for D 



4. Institutional Emphases (Please distribute 100 points) 

Jp-- Institution A emphasizes human resources. 

"points High cohesion and morale in the school are 
f0f A important. 




points 
for B 



I 



points 
forC 



Institution C emphasizes permanence and 
stability. Efficient, smooth operations are 
important. 



points 
forD 



. Institution B emphasizes growth and acquir- 
ing new resources. Readiness to meet new 
challenges is important. 

Institution D emphasizes competitive actions 
and achievement Measurable goals are 
important. 



SECTION 6: Institutional Strategy; 



The following section deals with the strategy your institution is pursuing. Please 
■ndicate the extent to which you agree or disagree with each Item, based on your 
■own perceptions. 



i 
i 
i 
i 
i 
i 
i 
i 
i 



1 . We are making our academic programs more diverse. 
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4 
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2. We are changing the composition of our student body, making it more diverse. 


1 


2 


3 


4 


5 


-»I 


3. We are increasing the investment of the college in functions that deal with external 
people (admissions, development, government relations, and oihers). 


1 


2 


3 


4 


5 


-•2 


4. This institution tries to insulate itself from pressures in the environment. 


1 


2 


3 


4 


5 
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5. This institution tries new activities or policies, but not until after others have found 
them successful. 


1 


2 


3 


4 


5 


-to 


6. This institution is likely to be the first to try new activities or policies. 
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2 


3 


4 


5 
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7. Our top administrators educate important outsiders about the value of the institu- 
tion in order to improve its legitimacy in their eyes. 


1 


2 


3 


4 


5 
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8. This institution tends to do more of what it does well, to expand in areas where 
we have expertise. 


1 


2 


3 


4 


5 


-9? 


9. This institution establishes new domains of activity. 


i 


2 
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4 
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10. We are increasing the quality of the individuals in top administrative positions. 
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2 


3 


4 


5 
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1 1 . Top administrators emphasize finding new money, more so than saving money for 
a balanced budget. 
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4 
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12. The top administrative team has developed multi-year stategies to achieve long- 
term institutional objectives. 
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1 3. The top administrative team receives rapid and accurate feedback about enrollment 
and financial conditions. 
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14. The top administrative team provides incentives for conserving resources. 
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i SECTION 7: institutional Decision Processes! 



The following questions deal with the decision process used at the Institution for 
allocating resources -whether the resources are staff positions, dollars, space or 
other valuable Items. Please Indicate the extent to which you agree or disagree with 
each Item. • 

1 . This institution has a sf-ndard set of procedures it uses to make resource allocation 
decisions. 

2. One Individual at this institution makes all resource allocation decisions of any 
consequence. 

3. People at this institution make resource allocation decisions collegially. 

4. A rational process is used to make resource allocation decisions at this institution. 

5. No particular pattern characterizes the process by which resource allocation 
decisions are made here. 

6. Resource allocation decisions are political, based on the relative power of those 
involved. 

7. Resource allocation is decided bureaucratically at this institution. 

8. Resource allocation is decided autocratically. 

9. Resource allocation is a matter for group discussion and consensus 

10. Resource allocation decisions are based on what objectively seems best for this 
institution overall. 

1 1 . Resource allocation is decided by coincidence; it is . matter of organized anarchy. 

12. Persuasion, negotiation, and coalition-building are examples of what determines 
resource allocation. 
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SECTION 8: Performance and Actions of the Institution! 



The Items In this section ask about the performance and actions of your institution. 
If you are not sure of the Item, please make your best guess. 

To what extent are the following characteristics typical of this Institution? 

1. One of the outstanding features of this institution is the opportunity it provides stu- 
dents for personal development in addition to academic development. 

2. This college is highly responsive and adaptive to meeting the changing needs of its 
external constituencies. 

3. This college has a very high ability to obtain financial resources in order to provide a 
high quality educational program. 

4. When hiring new faculty members, this college can attract the leading people in the 
country in their respective fields to take a job here. 

5. There seems to be a feeling that dissatisfaction is high among students at this 
institution. 

6. There have been relatively large numbers of students either drop out or not return 
because of dissatisfaction with their educational experience here. 

7. 1 am aware of a large number of student complaints regarding their educational 
experience here as registered In the campus newspaper, meetings with faculty 
members and administrators, or other public forums. 
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Performance and Actions of the Institution (continued) 



8. There is a very high emphasis on activities outside the classroom designed specif- 
ically to enhance students' personal, non-academic development. 

9. There is a very high emphasis on institutioncommunity or institution environment 
activities. 

10. Students develop and mature in non-acdemic areas (e.g., socially, emotionally, 
culturally) to a very large degree directly as a result of their experiences at this 
institution. 

1 1. A very large number of community oriented programs, workshops, projects or 
activities were sponsored by this institution last year. 
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12. Think of last year's graduating class at this institution. Please rate the academic attainment or academic level 
achieved by that class as a whole. (Select one) ocoacmit icvei 

1) That class is among the very top classes 

in th* country. 

2) That class is atove average. — 

3) That class is about average. 



. 4) That class is below average. 

5) That class is near the bottom of classes 
across the country. 



13 " ?ofeSior^scho^ m * ^ VadMttS fr ° m 0,15 institution Qo on to obtain degrees in graduate or 



. 1) From 91% to 100% or the students 
here go on for advanced degrees. 

. 2) From 61 % to 90% go on. 

. 3) From 46% to 60% go on. 



. 4) From 16% to 45% go on. 

5) From 0 to 15% go on to obtain 
advanced degrees. 



15. 



16. 



17. 



Please use the following scale in responding to the following questions 

I -A small minority 2-Less than half 3-About half 4-More than half 5- A large majority 

14 HCW "»"y *"<knts would you say engage in extra academic work (e.g.. reading, studying, writing) 

over and above what is specifically assigned in the classroom. 

_ Whet proportion of the students who graduated from this institution last year and entered the labor 
market obtained employment in their major field of study? 

_ How many students would you say attend this college to fulfill definite career or occupational goals 
as opposed to attending for social, athletic, financial, o' other reasons? 

_ Of those students who obtained employment after graduating from this institution, for how many of 
them was career training received at this institution important in helping them obtain their jobs? 

l£Z^ Cha "?K! )f L takin ? J a * m , ilar , j ° b 81 an ° ther SCh0 ° l cf his or ** T •"«¥ Acuity 

members do you think would opt for leaving this school? 

- lil^^J^™* tok ' nfl * j ° b a, u 8n0ther $Ch °°' ° f his or her choic * h0 * ™>y adminis. 
trators do you think would opt for leaving this school? 

- SJ^JJE" m " ny faCU ' ty members at »»* in * titut ™ •« Personally satisfied with their 
_ Estimate how many administrators at this college are personally satisfied with their employment. 
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18. 



19. 



20. 



121. 
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-123 



-126 



-127 



-128 



-130 



-131 



-132 



-133 



-134 



-133 



-136 



-137 



-1M 
-13» 



22. 



23. 



24 



25. 



•Performance and Actions of the Institution (continued) — — — — 

^eSlt^T^S^ in ?^ 0n W0U ' d yOU My P" blished 8 book or »" «"*le a 
professional journal, or displayed a work of art in a show last year? 

* ^ r T mberS WOuld ^ teach at the "cutting edge" of the,r 

«™ ™yj faculty number, jat this college are actively engaged now in professional development 
•cMties-e.g., doing research, getting an advanced degree, consulting, etc? 

Colleges may be rated on the basis of their relative "drawing power" in attracting top hiqh school 

S££- « 2r t ? n l ° ? her . C0,,e «« * ith " hich » compete?, what proportion o?the to^studenj 
attend this institution rather than the competition? *«Joerus 



n^^^tX? ^ J! U L Pe T? iW,$ * fleneral da y to - da y functioning of the overall institution Please 
Zdd SSSfS^f T^I T"*"* y0ur Potions * each item, rf you agree stron^y with one 

TOR EXAMPLE- 

How is the weather in this town? 
warm, bright, and sunny 



1(2; 3 4 5 

How do you perceive the following? 

26. Student/faculty relationships 
unusual closeness, lots of informal 
interaction, mutual personal concern 

27. Equity of treatment and rewards 
people treated fairly and 
rewarded equitably 

28. Organizational health of the college 
college runs smoothly, healthy 
organization, productive internal 
functioning 

29. General levels of trust among people here 
high suspicion, fear, distrust, 
insecurity 

30. Conflicts and friction In the college 
large amount of conflict, disagree 
ments. anxiety, friction 

31. Recognition and rewards received for good work from superiors 
recognition received for good 

work, rewarded for success 1 2 3 4 5 

32. The amount of information or feedback you receive 
feel Informed, in the know, 

information is always available 1 2 3 4 5 



cold, wet, and dismal 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



12 3 4 5 



no closeness, mostly instrumental 
relations, little informal interaction 



favoritism and inequity present, 
unfair treatment exists 

college runs poorly, unhea.thy 
organization, unproductive internal 
functioning 

high tart, security, openness 



no friction or conflicts, friendly, 
collaborative 



no rewards for good work, no one 
recognizes success 



feel isolated, out of it, 
information is never available 



r * 
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■SECTION 9: Respondent Demographics! 



The* items ask for tome personal demographic information. This information will not be used to trv to 
Identify you. rather it simply will h jp us in our analysis of the questionnaire data. Pte.se awweTeacn Hem 

1. How many years of age are you? 



2. In how many edixational organizations have you worked in your professional career? 

3. How many years have you held your current position? 

4. Are you male- or female ? 

5 ' dl£< y 2r IfS^yf 9 ^ ^'^ baChel0rS ' ma$tef5 ' ° r doctorat «> «V of the following fields? (pkase 

l\ t?**? administration 4) Health Care administration 

2 ^ ^^tion 5 ) Personnel or Industrial administration 

3) Public administration 6) other administration fields 

6. In what field did you receive your last degree? 

1) Humanities (e.g., literature, languages) 

2) Pine Arts (e.g., music, sculpture) 



-152 
133 



-154 
153 



-I* 
13? 



-139 



3) Physical Sciences (e.g.. physics, chemistry) 

4) Biological Sciences (e.g., zoology, botany). 

5) Social Sciences (e.g., sociology 
economics) _ 



. 6) Mathematics and Computer Sciences 
. 7) Professional Relos (e.g., taw, 

engineering) 
. 8) Administration Fields (educational, 

business) 
9) Other 



7. Kow many years have you been affiliated with this institution? 

8. What is your highest academic degree? 

1) Doctorate or other terminal degree 

2) Masters 

3) Bachelors 

4) Associate 



-160 



-161 
162 



-163 



yo?r.rMo^ h hVre wUh^r "* ^ *"* °" r ""^ ** « "^hing else 
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Appendix 2 




An Assessment of 
the Performance 
of Colleges and 
Universities 



National Center for Higher Education Management Systems 
P.O. Drawer P Boulder, CO 80302 
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Dear Respondent: 



This questionnaire is part of a national study of performance in colleges and univer- 
sites conducted by the National Center for Higher Education Management Systems 
Several administrators, faculty department heads, and trustees at your institution are 
completing this instrument. You were selected as a respondent because of the posi- 
tion you hold at this school. 

We are seeking your perceptions of the overall institution rather than information 
about one parhcular department or program. The responses of all individuals will 
remain stnctly confidential. The data will be analyzed at NCHEMS in Boulder 
Colorado and all individual responses will be aggregated. In addition, the name of 
your institution w.l! be revealed only to individuals at your school in the feedback 
reports to be provided at the conclusion of the study. Vou will be able to compare 
your institution with other similar schools, but the other schools will be described on 
the basis of their general characteristics, not by name. 

The questionnaire is designed to be mailed back to NCHEMS without needing an 
envelope. On the back cover is printed the address of NCHEMS, along with a sticker 
•denting your institution as the return address. Just seal up the questionnaire and 
drop it in the mail. We will pay the return postage. You will find three peel-off stickers 
mailinglt <l uestionnair e for your use in sealing up the questionnaire prior to 

Please complete the questionnaire at your earliest convenience; if possible we 

W ~ ?20 S? n J? ^ I?*? y ° U reCCived * Previous re ^ents have 
averaged 20 minutes to complete the questionnaire, so despite its length, we hope 

romm. , ? UeSt ' f 0n ^ ntereStin9 and thou S ht -Provoking. If you have questions or 
comments, please feel free to contact Dr. Kim Cameron at (303) 497-0368 Thank 
you in advance for your cooperation. 
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SECTION 1 : Changes in the Institution's External Environment \ 



The following questions concern changes in conditions outside your institution over 
the past few years. Please circle the number to the right of each statement that 
best reflects your institution's experiences since 1979-80. 

1 . Major factors outside our institution that affect its enrollments have become more 
predictable over the past few years. 

2. Major factors outside the institution that affect its revenues have become less 
predictable over the past few years. 

3. Competitive actions of other colleges and universities have become more 
predictable over the past few years. 

4. The tastes and preferences of students have become harder to forecast over the 
past few years. 

5. Competitive actions of other colleges and universities now affect this institution in 
more areas (e.g., price, programs, area served) than in the past. 

6. Competition with other colleges and universities for student enrollments has 
increased over the past few years. 

7. The number of potential students from whom our institution can recruit has 
increased over the past few years. 

8. Financial resources have become ./lore difficult to obtain over the past few years. 






2 


3 


4 


5 
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2 


3 


4 


5 
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2 


3 


4 


5 
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2 


3 


4 


5 
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2 


3 


4 


5 
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2 


3 


4 


5 
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2 


3 


4 


5 
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2 


3 


4 


5 
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iSECTION 2: Decreasing Enrollments? 



This section is concerned with whether your institution has experienced decreasing 
full-time equivalent enrollments during any of the academic years since 1979-80. 

1 To the best of your knowledge, did full-time equivalent student enrollments 
decrease from one year to the next during any of the academic years from ] 979-80 
to 1982-83? 

If you answered "no" to the above question, please skip to Section 3 on the following 
page If you answered "yes," please complete the remaining items in this section 

2. Please check the years in which you believe that full-time equivalent enrollments 
decreased from those of the previous year. 



197980 



1980-81 



1981-82 



Please circle the number to the right of each statement that best reflects your insti- 
tution's experiences during its most recent episode of decreasing enrollments. 

3. Decreasing enrollments were inevitable at that time. 

4. Decreasing enrollments presented an immediate threat to the viability of this 
institution. 

5. Predictions of decreasing enrollments provided adequate lead time to take actions 
that minimized their impact 

6. Decreasing enrollments were a short-term problem. 

7. Please indicate in the space below the major factors that caused enrollments to 
decrease at your institution. 
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(]) Yes 



(2) No 



1982-83 




-20 21 
22 23 



-2b 
-2/ 



-28 29 
30 31 
3? 33 



SECTION 3: Decreasing Revenues 



This section is concerned with whether your institution has experienced decreasing 
revenues, adjusted for inflation, during any of the academic years since 1979-80. 

1 . To the best of your knowledge, did revenues, adjusted for inflation, decrease from 
one year to the next during any of the academic years from 1 979-80? 



If you answered "no" to the above question, please skip to Section 4, which begins on 
this page. If you answered "yes," please complete the remaining items in this section 



( 1 ) Yes 

(2) No 



2. Please check the years in which you believe that revenues, adjusted for inflation, 
decreased from those of the previous year. 

1979-80 1980-81 1981-82 

Please circle the number to the right of each statement that best reflects your insti- 
tution's experiences during its most recent episode of decreasing revenues. 



3. Decreasing revenues were inevitable at that time. 

4. Decreasing revenues presented an immediate threat to the viability of the 
institution. 

5. Predictions of decreasing revenues provided adequate lead time to take actions that 
minimized their impact 

6. Decreasing revenues were a short-term problem. 

7. Please indicate in the space below the major factors that caused revenues to 
decrease at your institution. 



1982-83 




1 


2 


3 


4 


5 


] 


2 


3 


4 


5 


1 


2 


3 


4 


5 


i 


2 


3 


4 


5 



-36 37 . 
38 39 1 



-40 



-42 
-43 



-44 45 1 
46 47| 
48 49 B 



•SECTION 4: Institutional Characteristics 



In this section, we are asking for your impressions of some general characteristics 
of your institution. Please answer each item. If you are not sure, make your best 
guess. 
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]. 


This institution has many administrators performing specialized functions. 




2 


3 


4 


5 
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2. 


Formal policies and rules govern most activities at this institution. 




2 


3 


4 


5 
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3. 


This institution has a special identity, unlike any other in higher education. 




2 


3 


4 


5 
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4. 


There is a general sense that this institution has a distinctive purpose to fulfill. 




2 


3 


4 


5 
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5. 


The academic programs offered here reflect the mission of the institution 




2 


3 


4 


5 
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6. 


People associated with this institution share a common definition of its mission. 




2 


3 


4 


5 
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7. 


Those who make a personal or financial investment in this institution believe that 
they receive an ample return. 




2 


3 


4 


5 
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8. 


The activities of the various units in this institution are loosely coordinated or loosely 
coupled. 




2 


3 


4 


5 
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9. 


Major decisions are very centralized. 




2 


3 


4 


5 
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10. 


Long-term planning is neglected. 211 




2 


3 


4 


5 
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Institutional Characteristics (continued) 




1 1. 


Innovative activity is increasing 


1 


2 


3 


4 


D 
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1 2. 


Top administrators are often scape goats. 


1 


z 


J 


A 

4 


D 
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1 3. 


There is a lot of resistance to change in this school. 


1 


2 


*3 
J 


4 
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14. 


There is a great deal of turnover in administrative positions. 


1 


2 


*3 
J 


A 

4 


D 


—64 


1 a 
ID. 


Morale is increasing among members of this institution. 


i 
i 




*3 
J 


A 

4 




—65 


16. 


We have no place that we could cut expenditures without severely damaging the 
school. 


i 


Z 


"3 
J 


A 

4 


D 
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17. 


Special interest groups within the institution are becoming more vocal. 


l 


2 


3 


4 


5 
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18. 


Top administrators have high credibility. 


I 


2 


3 


4 


5 
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19. 


W r en cutbacks occur, they are done on a prioritized basis. 


l 


2 


3 


4 


5 
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20. 


Conflict is increasing within this institution. 


l 


2 


3 


4 


5 
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21. 


Top administrators believe that factors outside the institution largely determine its 
condition. 


l 


2 


3 


4 


5 
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22. 


Top administrative positions are now held by individuals who were promoted from 
within the institution. 


l 


2 


3 


4 


5 


-72 



SECTION 5. Type of Institution! 



These questions relate to the type of organization that your institution is most like. Each of these items con- 
tains four descriptions of institutions of higher education. Please distribute 100 points among the four descrip- 
tions depending on how similar the description is to your school. None of the descriptions is any better than 
the others; they are just different. For each question, please use all 100 points. 

FOR EXAMPLE: 

In question 1 , if institution A seems very similar to mine, B seems somewhat similar, and C and D 
do not seem similar at all, I might give 70 points to A and the remaining 30 points to B. 



1 . Institutional Characteristics (Please distribute 100 points) . 



points 
for A 



for C 



Institution A is a very personal place. It is like 
an extended family. People seem to share a lot 
of themselves. 



— Institution C is a very formalized and struc- 

points tured place. Bureaucratic procedures gen- 
erally govern what people do. 



points 
for B 



Institution B is a very dynamic and entrepre- 
neurial place. People are willing to stick their 
necks out and take risks. 



Institution D is ve^y production oriented. A 

points major concern is with getting the job done. 
People aren't very personally involved. 



for D 



-74 lb 
76 11 
78 79 
80 8! 



2. Institutional Leader (Please distribute 100 points) 



points 
for A 



points 
forC 
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The head of institution A is generally consid- 
ered to be a mentor, a sage, or a father or 
mother figure. 

The head of institution C is generally consid- 
ered to be a coordinator, an organizer, or an 
administrator. 



points 
for B 



points 
for D 
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The head of institution B is generally consid- 
ered to be an entrepreneur, an innovator, or 
a risk taker. 

The head of institution D is generally consid- 
ered to be a producer, a technician, or a hard- 
driver. 



-82 83 
84 85 
86 87 
88 89 



Type of Institution (continued) 



3. Institutional "Glue" (Please distribute 100 points) 

The glue that holds institution A together is 

points loyalty and tradition. Commitment to this 
for A school runs high. 

The glue that holds institution C together is 

points formal rules and policies. Maintaining a 
forC smooth-running institution is important here. 



The glue that holds institution B together is a 

points commitment to innovation and develop- 
tor B ment. There is an emphasis on being first. 

The glue that holds institution D together is the 

points emphasis on tasks and goal accomplishment. 

for D A production orientation is commonly shared 



4. Institutional Emphases (Please distribute 100 poin 

Institution A emphasizes human resources. 

P°' nts High cohesion and morale in the school are 
forA important. 

Institution C emphasizes permanence and 

points stability. Efficient, smooth operations are 
forC important. 



Institution B emphasizes growth and acquir- 

pomts i n g new resources. Readiness to meet new 
for 6 challenges is important. 

institution D emphasizes competitive actions 

. . -98 99 

points dnc i achievement. Measurable qoals are 100 101 

fnr H 102 103 

u important. icm 105 



! SECTION 6: Institutional Strategy. 



The following section deals with the strategy your institution is pursuing. Please 
indicate the extent to which you agree or disagree with each item, based on your 
own perceptions. 

1. We are making our academic programs more diverse. 

2. We are changing the composition of our student body, making it more diverse. 

3 We are increasing the investment of the college in functions that deal with external 
people (admissions, development, government relations, and others). 

4. This institution trie ', to insulate itself from pressures in the environment. 

5. This institution tries new activities or policies, but not until after others have found 
them successful. 

6. This institution is likely to be the first to try new activities or policies 

7. Our top administrators educate important outsiders about the value of the institu- 
tion in order to improve its legitimacy in their eyes. 

8. This institution tends to do more of what it does well, to expand in areas we have 
expertise. 

9. This institution establishes new domains of activity. 

10. We are increasing the quality of the individuals in top administrative positions 

1 1 . Top administrators emphasize finding new money, more so than saving money, for 
a balanced budget. 

12. The top administrative team has developed multi-year stategies to achieve long- 
term institutional objectives. 

1 3. The top administrative team receives rapid and accurate feedback about enrollment 
and financial conditions. 



14. The top administrative team provides incentives for conserving resources. 
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Institutional Strategy (continued) 



1 5 Of the four actions listed below, which one is the most likely response of this institution to changes in the 
outside world? (check one response) 

1 . Change the institution's policies and procedures 

2. Change the institution's image through communication 

3. Change the kinds of students, suppliers, or donors we deal with 

4. Weather any storm, making no change^ -121 

16. Of the four actions listed below, which one is the least likely response of this institution to changes in the 
outside world? (check one response) 

1 . Change the institution's policies and procedures 

2. Change the institution's image through communication 

3. Change the kinds of students, suppliers, or donors we deal with 

4. Weather any storm, making no changes -122 



SECTION 7: Institutional Decision Processes 



The following questions deal with the decision process used at the institution for 
allocating resources — whether the resources are staff positions, dollars, space, or 
other valuable items. Please indicate the extent to which you agree or disagree with 
each item. 




1. 


This institution has a standard set of procedures it uses to make resource allocation 
decisions. 


1 


2 


3 


4 


5 


2. 


One individual at this institution makes all resource allocation decisions of any 
consequence. 




2 


3 


4 


5 


3. 


People at this institution make resource allocation decisions collegially. 




2 


3 


4 


5 


4. 


A rational process is used to make resource allocation decisions at this institution. 




2 


3 


4 


5 


5. 


No particular pattern characterizes the process by which resource allocation 
decisions are made here. 




2 


3 


4 


5 


6. 


Resource allocation decisions are political, based on the relative power of those 
involved. 




2 


3 


4 


5 


7. 


Resource allocation is decided bureaucratically at this institution 




2 


3 


4 


5 


8. 


Resource allocation is decided autocratically. 




2 


3 


4 


5 


9. 


Resource allocation is a matter for group discussion and consensus. 




2 


3 


4 


5 


10. 


Resource allocation decisions are based on what objectively seems best for this 
institution overall. 




2 


3 


4 


5 


11. 


Resource allocation is decided by coincidence; it is a matter of organized anarchy. 




2 


3 


4 


5 


12. 


Persuasion, negotiation, and coalition-building are examples of what deterrrir,; . 
resource allocation. 


1 


2 


3 


4 


5 
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SECTION 8: Performance and Actions of the Institution! 



The items in this section ask about the performance and actions of your institution. 
If you are not sure of the item, please make your best guess. 

To what extent are the following characteristics typical of this institution? 

1 . One of the outstanding features of this institution is the opportunity it provides stu- 
dents for personal development in addition to academic development. 

2. This college is highly responsive and adaptive to meeting the changing needs of its 
external constituencies. 

3. This college has a very high ability to obtain financial resources in order to provide a 
high quality educational program. 

4. When hiring new faculty members, this college can attract the leading people in the 
country in their respective fields to take a job here. 

5. There seems to be a feeling that dissatisfaction is high among students at this 
institution. 

6. There have been relatively large numbers of students either drop out or not return 
because of dissatir f action vvith their educational experiences here. 

7. I am aware of a large number of student complaints regarding their educational 
experience here as registered in the campus newspaper, meetings with faculty 
members and administrators, or other public forums. 

8. There is a veiy high emphasis on activities outside *he classroom designed specif- 
ically to enhance students' personal, non-academic development. 

9. There is a very high emphasis on institution-community or institution-environment 
activities. 

10. Students develop and mature in non-academic areas (e.g., socially, emotionally, 
culturally) to a very larye degree directly as a result of their experiences at this 
institution. 

] ] . A very large number of community-oriented programs, workshops, projects, or 
activities were sponsored by this institution last year. 




1 

1 
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J 


A 


J 
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3 


4 


5 


-i 38 


1 


2 


3 


4 


5 


-139 


1 


2 


3 


4 


5 
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2 


3 


4 


5 
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1 


2 


3 


4 


5 
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] 


2 


3 


4 


5 
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] 


2 


3 


4 


5 
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1 


2 


3 


4 


5 
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1 


2 


3 


4 


5 
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1 


2 


3 


4 


5 
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12. Think of last year's graduating class at this institution Please rate the academic attainment or academic level 
achieved by that class as a whole. (Se'ect one) 



1 ) That class is among the very top classes 
in the country. 

2) That class is well above average. 

3) That class is slightly above average. 

4) That claSsS is about average. 



5) That class is slightly below average 

6) That class is below average. 

7) That class is near the bottom of 
classes acrosb the country 



-148 



1 3. Estimate what percent of the graduates from this ir 
schools. 

1 ) From 91 % to 100% of the students 

here go on for advanced degrees. 

2) From 76% to 90% go on. 

3) From 6] % to 75% go on. 

4) From 46% to 60% go on. 

O 

ERLC 



tion go on to obtain degrees in graduate or professional 

5) From 3 1 % to 45 % go on 

6) From ] 6% to 30% go on. 

7) From 0 to 1 5% go on to obtain 

advanced degrees. 

-149 
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• Performance and Actions of the Institution (continued)— 



Please use the following scale in responding to the following questions 



7 — All 

6 — A large majority 



5 — More than half 3 
4 — About half 2 - 



Less than half 
A small minority 



1 — None 



14 

15. 

16. 

17 

18. 

19. 

20. 

21. 
22 

23. 

24. 
25. 



How many students would you say engage in extra academic work (e g., reading, studying, writing) 
over and above what is specifically assigned in the classroom. 

What proportion of the students who graduated from this institution last year and entered the labor 
market obtained employment in their major field of study? 

How many students would you say attend this college to fulfill definite career or occupational goals 
as opposed to attending for social, athletic, financial, or other reasons? 

Of those students who obtained employment after graduating from this institution, for how many of 
them was career training received at this institution important in helping them obtain their jobs? 

If given the chance of taking a similar job at another school of his or her choice, how many faculty 
members do you think would opt for leaving this school? 

If given the chance of taking a similar job at another school of his or her choice, how many adminis- 
trators do you think would opt for leaving this school? 

Estimate how many faculty members at this institution are personally satisfied with their 
employment. 

Estimate how many administrators at this college are personally satisfied with their employment 

How many faculty members at this institution would you say published a book or an article in a 
professional journal, or displayed a work of art in a show last year? 

What proportion of the faculty members would you estimate teach at the "cutting edge" of their 
field— i.e., require current journal articles as reading, revise syllabi at least yearly, discuss current 
issues in the field, etc.? 

How many faculty members at this college are actively engaged now in professional development 
activities — e.g., doing research, getting an advanced degree, consulting, etc.? 

Colleges may be rated on the basis of their relative "drawing power" in attracting top high school 
students. In relation to other colleges with which it competes, what proportion of the top students 
attend this institution rather than the competition? 
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153 



156 
1 57 
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This section asks you to rate your perceptions of the general day-to-day functioning of the overall institution Please 
respond by circling the number that best represents your perceptions of each item. If you agree strongly with one 
end of the scale, circle a number closer to that end of the scale. If you feel neutral about the item, circle a number 
near the middle of the scale. 



FOR EXAMPLE: 

How is the weather in this town? 

warm, bright, and sunny 

How do you perceive the following? 

26. Student/faculty relationships 

unusual closeness, lots of informal 
interaction, mutual personal c ncern 



® 



3 4 5 6 7 



12 3 4 5 6 7 



cold, wet, and dismal 



no closeness, mostly instrumental 
relations, little informal interaction 



27. Equity of treatment and rewards 

people treated fairly and 
rewarded equitably 
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12 3 4 5 0 7 



216 



favoritism and inequity present, 
unfair treatment exists 



-16J 



-Performance and Actions of the Institution (continuad) 



28. Organizational health of the college 

college runs smoothly, healthy 
organization, productive internal 
functioning 

29. General levels of trust among people here 

high suspicion, fear, distrust, 
insecurity 

30. Conflicts and friction in the college 

larfe amount of conflict, disagree- 
ments, anxiety, friction 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



1 2 3 4 5 6 7 



31. Recognition and rewards received for good work from superiors 

re\cnition received for good 
work, rewarded for success 



1 2 3 4 5 6 7 



32. The amount of information or feedback you receive 

feel informed, in-the-know, 
information is always available 



1 2 3 4 5 6 7 



college runs poorly, unhealthy 
organization, unproductive internal 
functioning 

high trust, security, openness 



no friction or conflicts, friendly, 
collaborative 



no rewards for good work, no one 
recognizes success 

feel isolated, out-of-it, 
information is never available 
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! SECTION 9: Respondent Demographics! 



These items ask for some personal demographic information. This information will not be used to try to 
identify you, rather it simply will help us in our analysis of the questionnaire data. Please answer each item. 



1. In what year were you born?. 



3. How many years have you held your current position? 

4. Are you male or female ? 

5. Have you received degrees (i.e., bachelors, masters, or doctorate) in any of the following fields? (please 
check all that apply) 

1) Business administration 4) Health Care administration 

2) Educational administration 5) Personnel or Industrial administration 

3) Public administration 6) Other administration fields 

6. In what field did you receive your last degree? 

1) Humanities (e.g., literature, languages) 6) Mathematics and Computer Sciences 

2) Fine Arts (e.g., music, sculpture) 7) Professional Fields (e.g., law, 

3) Physical Sciences (e.g., physics, chemistry) engineering) 

4) Biological Sciences (e.g., zoology, botany) 8) Administration Fields (educational, 

5) Social Sciences (e.g., sociology business) 

economics) 9) Other 

7. How many years have you been affiliated with this institution? 



8. What is your highest academic degree? 

1 ) Doctorate or other terminal degree 

2) Masters 

3) Bachelors 

4) Associate 



-170 
171 

172 
173 



2. In how many organizations have you worked in your professional career? 175 



-176 
177 



!80 



181 
182 
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Appendix 3 



Comments from interviews pertaining to the 
Institutional Performance Survey 

Section 1-External Environment 
Enrollment Predictability, 

1. Major factors outside our institution that affect its 
enrollments have becone more predictable over the past few 
years • 

(A) I know what to expect during recessions. . . I know hew 
major changes in the economy affect us. 

Revenue Predictability. 

2. Major factors outside the institution that affect its 
enrollment have become less predictable over the past few 
years. 

(N) It's a matter of second guessing the legislature. 
Compet .or Predictabi ltiy . 

3. Competitive action of other colleges and universities have 
become more predictable over the past few years. 

!N) X will always be up to something. . .what does 
"predictable" mean?. . . 

Students 1 Tastes and Preferences. 

4. The tastes and preferences of students have become harder to 
forecast over the past few years. 

I don't know about other departments, but I know if I offer a 
course one year and enrollment is low, I don't offer it again, 

Our students are primarily looking for jobs . 

Intensity of Competition. 

5. Competitive actions of other colleges now affect this 
institution in more areas. 

Enrollment Competition. 

6. Competition with other colleges and universities for student 
enrollments has increased over the past few years. 

1 
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Supply of Students, 

7. The number of potential students from whom our institution can 
recruit has increased over the past few years. 

I'd say yes based cn population demographics. 

Availability of Financial Resources. 

8. Financial resources have become more difficult to obtain over 
the past few ye irs. 

. . .things aren't easy, but there hasn't been a substantial 
change. 

Section 4- Institutional Functioning 

Specialization . 

1. This institution has many administrators performing specialized 
functions . 

(A) I don't think about the "many" wording, but whether we have 
people working on specific kinds of tasks. 

(A) There seem to be a lot of people doing specific kinds of 
things . 

(A) It reflects the role differences on campus. 

(?) It's difficult to interpret what this means. What does 
"many" mean? We have specialists. 

I'm a dean, I have a specialized function. However, I could 
see others taking this to mean that there are too many 
administrators. 

(N) There are people who do specialized kinds of things, 
however, many of these could do different jobs with little 
additional training . 

Formalization. 



Formal policies and rules govern most activities at this 
institution. 

(A) From a student affairs perspective. . .the mentality is 
that if you break rules, you open yourself up to all kinds of 
problems. 

(A) There are handbooks for most things. . .but when things 
need to get done, you find ways. 
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Yes and no. The majority of activities are operated by 
policies and rules — tenure , grading. No, in the sense of 
personal decisionmaking, there are frequent debates among 
faculty. 

(D) This institution is not highly structured, it's flexible. 
WHAT DO YOU MEAN BY FLEXIBLE? Requirements, course times. 
Administration is not involved in these decisions. We can 
offer new courses without clearing it with anyone. 

(A) Our problem is the union. It requires things be much more 
formal than one would like. 

(N) At different levels there are different levels of 
formality, e.g., at the individual managerial level things are 
quite flexible. At the executive level the formality is 
useful . 

Mission, 

3. This institution has a special identity, unlike any other 
institution . 

(A) The school was set up with a specific mission. . .however, 
it's probably not clear to many. 

(A) It does, probably like most colleges. 

(D) As a private, Jesuit, Catholic school we're unlike many 
other privates; but we're not unlike any other in higher 
education. 

4. There is a general sense that this institution has a 
distinctive purpose to fulfill. 

(A) If we're talking about this school being one which stresses 
a quality undergraduate education — but it doesn't seem to be 
a distinctive purpose. 

(A) This seems like the same question as the last one. 

5. The academic programs offered here reflect the mission of the 
institution. 

(A) We don't offer graduate classes here. . .we have unique 
programs . 

(A) Its liberal arts and service orientation come to mind. 

(A) Every time I go to the trustees I have to show how programs 
meet the mission of the institution. 
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(A) We've done a lot of talking here about our mission — 

■ educating the whole person , not making them different, but 
J fulfilling the whole person. We do this through our extra- 
curricular activities, and some of our programs* 

■ I think we do this through establishing close personal 

■ relationships in the faculty* However, there are no formal 
mechanisms for indoctrinating faculty. Our expectations are 

■ often out of line with the tools we give them* 

6. People associated with this institution share a common 
m definition of its mission. 

(D) Sitting on various committees, it appears that while people 
share a common sense of mission, they have very different 

■ desires for what and where it should go. 

(A) People espouse common themes, but they're off in different 

■ directions. (CA) 

(A) There is a sense here that this school offers a quality 
_ education, and deals with undergrads on a personal basis. 

■ (A) It's a kind of service to humanity* . .through its 
graduates that will go out to be engineers and lawyers. 

■ (D) Most of us know what the mission and goal statement says, 
but most generally have a vague sense of what it means. 

| Investor Confidence. 

_ 7. Those who make a personal or financial investment in this 
I institution believe that they receive an ample return. 

(D) Currently there is a major hassle between faculty and 

■ administration over salaries. . .my opinion is clouded by 

■ recent disputes. 

m (D) What does "financial investment" mean? What our job is? 

(?) Who do you mean? Alumni, donors, parents, students? I 
hear a great deal of satisfaction from old alumni. 

■ (A) I assume you're talking about benefactors. Well, they 
generally return to give again. 

| I don't know about financial, but personal — yes. Those front 

line managers and directors of departments. 

I Structural Coupling. 

8. The activities of the various units in this institution are 

■ loosely coordinated or loosely coupled. 

4 
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(A) Department X does its thing. Professionals are more 
committed to their individual disciplines than their 
departments, their school, or the institution. 



(A) There is no administrative guidance. . . It doesn't exist 

(?) What does "unit" mean? Departments? No, because of the 
structure of departments. 

(?) What does that mean? Various colleges come to mind, and 
student services. There's very little coordination — but I 
don't mean this in a negative sense. 

(N) At times projects are well-coordinated. Other times, the 
right hand doesn't know what the left is doing. 

Centralization . 

9. Major decisions are very centralized. 

(D) Within any divisiop things may be centralized. . .it's not 
clear. I have difficulty envisioning what this means. . . I 
think of the extent to which decisions occur from a give and 
•take situation. * 

(A) Major decisions are made by administration. 

(D) We will institute a new major in communications. The 
decision had to go to the trustees, but this was just pro- 
forma. 

(?) What do you consider a major decision? An immunization 
policy, or student discipline? 

Planning . 

10. Long-term planning is neglected. 

(N) Yes and no. . . Things were set in motion, but current 
events over-power intents. 

(D) I see new programs, financial campaigns, building programs, 
creation of new courses. 

(A) We need jnore. Not very much of it is done in either the 
financial or academic side. 

(SD) We do a lot of talking, but I haven't seen the results. 
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Innovation , 

11. Innovative activity is increasing, 

I strongly dislike the "increasing/decreasing" language in the 
questionnaire. What if things were consistently high or low, 
how should I respond? 

(A) People receive support for new ideas here, although not as 
strong as it used to be, this is the fault of the deans not th 
president. 

(N) Activity is fairly stable — that is, we have new programs 
and such, but this has been fairly constant. 

Scapegoating . 

12. Top administrators are often scapegoats. 

Do I mark it high if T think they are responsible for problems 
or because they're held accountable for things not under their 
power ? 

(A) Administrators take the heat for unpopular decisions. 

With the deans, criticism is just — they are in error. With 
respect to the president, perhaps due to his invisibility. 

(A) If there is a serious problem, that's the first place you 
usually look — but there have been no major problems in the 
past few years. 

Resistance to Change. 

13. There is a lot of resistance to change in this school. 

(A) Deans put proposals forward, but the programs are always 
stopped. 

(D) Change always needs to be debated, but there is little 
resistance — the most being on the part of students. 

(D) Relative to other schools, no. Educational institutions 
are, by nature, conservative. 
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Administrative Turnover. 
J 14. There is a great deal of turnover in administrative positions. 
(D) There's not much turnover except due to death. 

■ Seems the same as in other schools, 

■ Morale. 

15. Moral is increasing among members of this institution. 

■ I can't answer because I don't know how most others feel. . . 
I can tell you how my morale is. 

■ (?) Perhaps not increasing, but it's quite high. It was higher 
m under the previous 2 presidents. 

■ (A) Other institutions are scrounging for institutions. Our 
g applications are increasing. 

_ Slack Resources. 

■ 16. We have no place that we could cut expenditures without 

severely damaging the school. 

■ (D) Administrative positions have a lot of fat. 
m (A) The development office and student services. 

(D) Athletics, marginal or small programs. 
I Interest Groups. 

17. Special interest groups within the institution are becoming 

■ more vocal. 

(D) There are no special interest groups here. 

I (D) Moral is generally high. It's difficult to define special 

m interest groups here. 

I Administrator Credibility. 

18. Top administrators have high credibility. 

| (D) No decisions are being made. They keep power and money for 

themselves. They work for themselves. 

I (?) What do you mean by top administrators? The deans? They 

■ are very weak. There is no evidence against the president or 
VPs. 

7 

ERiC 225 



(A) People are generally pretty satisfied with the decision- 
making process here. 

Reallocation Priorities, 

19. When cutbacks occur, they are done on a prioritized basis. 

(D) Things are done by whim. There is never a clear discussion 
of priorities. 

They haven't occurred, 

(N) They haven't occurred. . . Thank god we haven't had to 
deal with this problem. 

Conflict. 

20. Conflict is increasing within this institution. 

(N) I really can't answer because conflict has always been 
high. 

(?) Most people are very satisfied even though they gripe. 
Locus of Control . 

21. Top administrators believe that factors outside the institution 
largely determine its condition. 

(A) It's convenient to make the legislature and economy 
scapegoats. 

D: They know they have to be realistic and attend to what's 
going on outside. 

?: I don't really know. I have my personal feelings. . .we 
have top faculty and outstanding students — these determine 
our condition. 

Internal Mobility. 

22. Top administrative positions are now held by individuals who 
were promoted from within the institution. 

(N) Some are, some aren't. . .oftentimes positions are filled 
by friends. 

A: President and AVP-finance were promoted from within. 
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Section 5-Institutional Culture 



Institutional Culture, 

The instructions are confusing, I had to go back and redo my 
answers. It's extremely difficult for me to distinguish between 
many of these. I don't associate the same things with a "personal 
place" that you do, I don't agree with your description/distinction 
between the types — e,g, f between entrepreneurial and production, 
A place can be both, 

I found the distribution of points idea very confusing and 
difficult. 

Section 6-Institutional Strategy 

Diversity, 

1, We are making our programs more diverse, 

(A) New programs keep cropping up. , .but is diverse good or 
bad? 

(A) There's a new TV program , a communications program r a new 
system of minors and double majors. 

(N) Programs are more diverse than the*; useu to be f but there's 
not been much change in the last few 5 ears. 

2, We are changing the composition of our student body, making it 
more diverse. 

(N) I don't know how to answer, we have always served a very 
diverse clientele. 

(A) We are attempting to do so; there's more nationwide 
recruiting . 

Conservatism. 

4. This institution tries to insulate itself from pressures in the 
environment. 

Insulate? Shouldn't it? It's a very loaded word. Is it like 
being an ostrich, or being smart? 

What does that mean? Tuition keeps going up? 

(D) I think of much of what went on around here in the 1960s. 

7. Our top administrators educate important outsiders about the 
value of the institution in order to improve its legitimacy in 
their eyes. 

9 
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I don't know what they do. I've seen them on TV, 

(A) We put a lot ot dollars in PR; we just finished a big fund 
raising drive; there's a heavy development emphasis. 

Moderate Change. 

5. This institution tries new activities or policies, but not 
until others have found them successful. 

Sounds like the prudent way to go. . . If I answer positively, 
does that make the institution look good or bad? 

(D) No matter what the institution says about itself. 

(?) I don't know, there's the MBA program. 

8. This institution seems to do more of what it does well, to 
expand in areas where we have expertise. 

This question seems very poorly worded. The first part is a 
truism. The second part seems like a reasonable question. 

It attempts to do that — e.g., there have been a series of 
institutes, our values orientation as a catholic school. 

Innovation. 



6. This institution is likely to be the first to try new 
activities or policies. 

Isn't this the same as question #5? 
9. This institution establishes new domains of activity. 

(N) Not really new activities. 
Administration . 

3. We are increasing the investment of the college in functions 
that deal with external people. 

There are agencies in place to do these things. However, I 
don't know how you calculate change. 

(A) We seem to be doing that — there's the emphasis on 
development. 

There is a much larger admissions staff and counselors; 
minority recruitment, development office. 
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11. 



Top administrators emphasize finding new money , more so than 
saving money, for a balanced budget. 



(D) . . .people are penalized for finding new money. There is 
no support for such efforts except at the departmental level. 
There is not even copying support; there's no rewards, in fact 
there are disincentives personally and professionally. 

(?) What should I say. We do both. People wonder when the 
development push will pay off. 

12. The top administrative team has developed multi-year strategies 
to achieve long-term institutional objectives. 

(D) There are none. . .no vision. . .no attempt to specify 
priorities . 

(D) I don't see any evidence of this. When asked to 
participate, these activities seem to go nowhere. 

13. The top administrative team receives rapid and accurate 
feedback about enrollment and financial conditions. 

(?) I don't know. . .messages are mixed and we need to know 
[about what's happening to the school]. . . People are 
prepared to deal with realities, but they don't like to be lied 
to, or have soft data. 

(A) They seem to be really up on this. 

14. The top administrative team provides incentives for conserving 
resources. 

(D) There does not seem to be any effort to conserve 
resources. 



Bureaucratic Allocation. 

1. This institution has a standard set of procedures it uses to 
make resoirce allocation decisions. 

(A) There are clearly specific processes that must be gone 
through. 

(D) I don't see a whole lot of standardization around here — 
especially in resource allocation. 

(?) I don't know how things are done at the institutional 
level. There seems to be small struggles going on, at least 
there don't seem to be standardized procedures. 



Section 7-Resource Allocation 



(A) Yes. 



Whoever screams the loudest. 
11 
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7. Resource allocation is decided bureaucratical ly at this 
institution. 

(A) There is a system which is strongly bureaucratic. It's 
very formal. At the same time it does allow for appeals. 

Autocratic Allocation. 

2. One individual at this institution makes all recourse 
allocation decisions of any consequence. 

(D) It's simply not true ~ there's the Board of Trustees, the 
VPs. 

(S) From what I can see, they seem to be made by executive 
officers. 

(S) This year student services had major cutbacks. 

(?) I have no idea who makes decisions. . .the business office 
is a total mystery to me. 

Collegial Allocation. 

3. People at this institution make resource allocation decisions 
col legial ly . 

(A) At the departmental level, yes. However, at the 
institution level, politics prevail. 

(A) At least in my own department. We divide classrooms 
democratical ly . 

(A) While it's not done by committees, it often occurs through 
recommendations . 

9. Resource allocation is a matter for group discussion and 
consensus • 

(?) It is within departments, not within the college. 
Departments are in the dark about what's going on in other 
places • 

Rational A 1 location . 

4. A rational process is used to make resource allocation 
decisions at this institution. 

(A) We attempt to do it rationally,. At least there is no 
Buddy System. 
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(A) At the departmental level, yes. However , at the 
institution level, politics prevail. 



10. Resource allocation decisions are based on what objectively 
seems best for this institution overall. 

(A) This year, the academic budget increased, and student 
services did not. 

Allocation as Organized Anarchy. 

5. No particular pattern characterizes the process by which 
resource allocation decisions are made here. 

What do you mean by "pattern"? There's a particular process. 
However, I don't know what other departments spend; or even 
what they pay their secretaries. One assumes equity, but one 
doesn't know. 

11. Resource allocation is decided by coincidence; it is a matter 
of organized anarchy. 

(D) The system alone obviates that possibility. 
Political Allocation. 

12. Persuasion, negotiation, and coalition-building are examples of 
what determines resource allocation. 

(A) To some extent there seems to be an element of that. 



Student Educational Satisfaction . 

5. There seems to be a feeling that dissatisfaction is high among 
students at this institution. 

(N) They want more challenge. . .we're underestimating their 
ability. 

(D) Which isn't to say we highly satisfy students. WHAT ARE 
MOST STUDENTS LOOKING FOR? To keep promises regarding personal 
treatment; a Catholic education — even though they may not 
know what it is. With international students, location and a 
private school. In undergrads, most come here because it's a 
Catholic school. 

(D) Students would move if they were dissatisfied . However, 
we really have no attrition data. There is a built-in loyalty 
over generations to this school. 



Section 8- Institutional Effectiveness 
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(N) I don't have a whole lot of contact witn students. 



6. There have been relatively large numbers of students either 
drop out or not return because of dissatisfaction with their 
educational experiences here, 

(A) There really is no follow-up. I can share my perceptions 
from advising. . . 

I don't know. I haver.'t heard students say, "I'm leaving 
because I don't like it here." One of our problems is that we 
don't know why students leave. I don't know what the attrition 
rate is. 

(N) However, there is a high attrition in nursing. Many 
students accepted in nursing never enroll here. There's no 
personal contact. 

7. I am aware of a large number of student complaints regarding 
their educational experience here as registered in the campus 
newspaper, meetings wi c-i faculty members and administrators, or 
other public forums. 

Most of us discount what we read in the campus newspaper. Our 
students seem to be shy about voicing public complaints. 

(?) I don't know about the number. 

Students are pretty passive today. I don't see much student 
unrest. 

Student Academic Development . 

12. Think of last year's graduating class at this institution. 
Please rate the academic attainment or academic level achieved 
by the class as a whole: scale 1-5 relative to other schools in 
the country. 

(N) The question makes little sense since we really can't know 
what other institutions are like. . .we have little to compare 
with. 

Probably above average. Classes vary from year to year. 

13. Estimate what percent of the graduates from this institution go 
on to obtain degrees in graduate or professional schools. 

I can't. There's no information. No real effort anyplace to 
keep track of this. 

14. How many students would you say engage in extra academic work 
over and above what is specifically assigned in the classroom. 
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I think I nay have left this blank or put neither. I really 
don't have any idea. 

Less than half. Many ]ust keep up. Students are not terribly 
intellectually curious. At the same time they have very heavy 
workloads . 

Student Career Development . 

15. What proportion of the students who graduated from this 

institution last year and entered the labor market obtained 
employment in their field of study. 

I really don't know. . .since much of our enrollment is in 
professional classes, probably many. 

I don't know. 

Student Personal Development . 

1. One of the outstanding features of this institution is the 

opportunity it provides students for personal development in 
addition to academic development. 

(A) I don't know about the college, but you can see it in the 
-school of Education. 

(A) There are a lot of people on campus who are genuinely 
committed to helping students. 

(A) The school provides opportunities but students don't always 
take advantage of them, e.g., counseling services in the dorms, 
and workshops, etc. 

(D) I don't see a whole lot of personal development. 
Activities are pathetic. Many students just go home. During 
accreditation we were told to improve our advising system. 
Only just recently did we set up procedures so students have 
the same advisor throughout school. Before that it could 
change every year. With the economic crunch some of our theory 
classes have more than 70 students. 

(A) you see faculty in the dorms, our small size, spiritual 
counselors. . . 

B. There is a very high emphasis on activities outside the 

classroom designed specifically to enhance students' personal, 
non-academi c development. 

(D) It varies tremendously according to departments. Generally 
not, partly as a function of who our students are. 
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(A) Counseling programs, student services, chaplain programs. 
(D) There's just none. 
Faculty and Administrator Employment Satisfaction . 

20. Estimate how many faculty members at this institution are 
personally satisfied with their employment. 

I really have no idea. 

It's hard to say. Nine or 10 months a year they've content. 
The other two months — during tenure decisions — you reach 
the peak of discontent. 

21. Estimate how many administrators at this college are personally 
satisfied with their employment. 

I really have no idea. 

System Openness and Community Interaction . 

2. This colleqe is hiQhly responsive and adapt- ive to meeting the 
changing needs of its external constituencies. 

(a) It attempts to. 

(D) There are no trend spotters. . .they have to buck the tide. 
Certain departments are, others are like dinosaurs. 

(?) Changing needs? What do you mear? We've tried to provide 
more money for students. We thought about a reentry program 
but it never got off the ground. 

Who do you mean by external constituencies? The community, 
health care in general, home care? Our curriculum must reflect 
what's happening in the external environment. 

9. There is a very high emphasis on institution-community or 
institution-environment activities. 

(A) Probably. . . I don't have any sense of what "institution- 
environment" means o 

(?) Institution environment doesn't mean anything to me. 

11. A very large number of community-oriented programs, workshops, 
projects, or activities were sponsored by this institution last 
year. 

(D) Whatever is sponsored comes out of faculty member hides... 
Not only does the institution not support this, it sets up 
roadblocks. 
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(?) Culturally, foreign students aren't really well accepted 
here. However, there was a food drive that raised $6000 for 
Ethiopia. The values of the institution seem to be overwhelmed 
by those of our society. 

Ability to Acquire Resources , 

3. This college has a very high ability to obtain financial 
resources in order to provide a high quality educational 
program. 

(D) Absolutely not. The Consortium simply does what it wants. 

(D) We can't get them as readily as we need them. I really 
don't know why enrollment dipped — unless it's because we went 
up the previous year. I don't know where to lay the blame. 

(A) Fund-raising campaign, matching grants; we've had strong 
alumni support over the past few years. 

(D) Most resources come from donations and gifts. There is 
very little grant money. We beat the bushes for student 
scholarships. The alumni association is xr er v v?eak. 

4. When hiring new faculty members, this college can attract the 
leading people in the country in their respective fields to 
take a job here. 

(D) Absolutely not. When we ^et them, administration refuses 
to accept them. We can't even advertise nationally. . .there's 
no travel money to bring them here. 

I don't know anything about hiring new faculty. I don't know 
if our salaries are adequate for SF. 

(?) Yes and no. We compete with Stanford and Berkeley for 
faculty, on the other hand housing is so expensive. 

(D) The only reason people ccme here is because it's in 
California and the bay area. Our nursing program does not 
attract national people. 

Organizational Health . 

26. Student/faculty relationships. 

(A) Probably ok. I really don't krow. 

(D) Faculty are always available to students. 

Close — I went to a state school, faculty doors are always 
open here. 
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1: There's lots of informal activity. Faculty give students 
their home phone numbers. 



27. Equity of treatment and rewards. 

(D) Because of who gets salary increases. 

2: Faculty people that have produced — research and teaching 
— have received them. 

You will hear of alleged inequitable treatment. But everyone 
wants to be judged on their strengths — which is not 
necessarily what the institution is concerned with. 

There are probably still some inequities. My concern is in the 
area of affirmative action — it's difficult in the humanities, 
they're always going to be behind in salaries. 

28. Organizational health of the college. 

(A) By this definition it seems to do ok in spite of itself. 
However, I don't agree with your definition of organizational 
health. . . I think of employee satisfaction and development, 
influence on decisionmaking. 

(A) The institution runs smoothly, there are occasional 
gliches. & 

2: The college runs fairly smoothly. It seems to be pretty 
well organized. People know who they should report to. 

29. General levels of trust among people here. 

3: Many faculty members feel there is not much openness. . . I 
think this president is no different than the others in terms 
of sharing information. . . I don't think there is a conscious 
desire for secrecy here. 

There's very high trust ~ but openness is a problem. The 
church itself is autocratic. What is accepted here would not 
be accepted on a state campus. People tend to trust priests 
even though they're not open. HOW DO YOU DEFINE OPENNESS? I 
think of resource availability — no one informs faculty about 
how many funds are used. 

There is some distrust on the part of the faculty. This 
resulted from the merging of the colleges without any 
consultation; and because they tried to change the semester 
system. 



IERLC 



18 n 

» 236 



30. Conflicts and friction in the college. 



4: People are pretty friendly here. . . One reason for this is 
that top administrators are pretty accessible. 

Who are you talking about? Staff, students, faculty; and 
where? There is some friction in some departments — this is 
probably normal where people work together. 

32. The amount of information and feedback 

(A) There's an organizational newsletter. . .and a lot of 
discussion in my group. 

2: Lots of things I don't care about. We're adequately 
informed about important things. 

It's hard to answer. Oftentimes the priests don't realize 
others want to know what's going on. In part, it's a response 
to when lay faculty were simply suffered here as an unavoidable 
necessity. 

Sometimes the president sends out letters, but often after the 
fact. My concern now is with a new personnel system that 
they've decided to put in place without informing anyone. 
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Appendix 4 



General Written Comments from 
Institutional Performance Survey Respondents 

Many of the responses in this questionnaire mist be taken with some 
reservation since there is no place to circle which corresponds 
precisely to my true feelings. Responses, therefore, must be 
judged to be approximate. 

I think this questionaire (sic) is a ridiculous waste of time. 

I have not answered questions I cannot understand ~ what, for 
instance, is a prioritized basis? In other cases I agree with 
part, but not all of the statement to be considered. 

1. Some questions either too broad or too vague. 

2. Many responses would be different if in respect of the 
university as a whole vs. the particular college in which I 
function. 



Sorry I'm late with this 



There are subtleties tnat the responses don't allow. I'm not as 
critical as some of the answers suggest or as enthusiastic as 
others may suggest. 

Moreover, some of the answers or questions allow only for labeling 
a stereotype upon a particular activity or feature and, therefore, 
do not evaluate with any depth. This was particularly true of the 
resource allocations process or non-process that is used here. It 
would take many pages to explain the process here and I'm not z _s 
any of it would be helpful or accurate after it was explained. 

Very interesting and well constructed instrument. 

Several questions made me feel as though I were a "hostile 
witness." Your answer really reflects assumptions as to the 
questioner's intent (sometimes difficult to divine). 

Questionnaire is much too long. I question the validity of 
responses to questions beyond the first two pages. 

A very comprehensive questionnaire. It is easier to answer the 
questions in many cases based on what happens within your own 
academic department. We are isolated somewhat in my college from 
others so I found it difficult to answer many questions. For 
example -- - our department is very close to the students personally 
but I know that this may not be true of other departments? Can we 
see the results somewhere? 



A waste of my time and th * school's money. 

Section 6 instructions are ambiguous -- • i.e., is the item presumed 
to be a fact and I agree or disagree with the strategy or is the 
item a question of fact and I judge whether or not it is true or 
0 £ alse and to what degree? Perhaps a clearer wording of the 
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Apart from the good questions — I felt your options should have 
included N/A and "don't know" especially in area of what students 
do upon graduation. 

You ask many questions of a factual nature which I could not answer 
accurately. Also, I have answered many questions rather 
negatively; although spirits are much higher here this year than 
last, memories die hard. I am hopeful and optimistic for the 
future . 

I'm in the law school and do not have enough information about how 
the university currently operates to answer most of your questions 
except with impressions and assumptions. 

Difficult to relate this to University as a whole — would be much 
more accurate data if based on school or department? As there is 
much variation here. 

J hope we're not paying for this study — too many generalities. 
Excellent questionnaire. 

Union/administrator conflict have influenced morale of entire 
univs it s i ty • 

VP Business /Finance not an academic, runs roughshod over everyone. 
THE single biggest problem since he is protected by President. 

I am very happy to see this type of self-study conducted at X. It 
is very much needed. We need to bring the secrecy and suspicion to 
an end, and develop more consultation and consensus in decision- 
making, more communication about decisions and their rationale, and 
less autocratic attitudes projected by the top financial 
management. 

What are you going to do with the results of this questionnaire? 
Respondents should be informed of survey results and what actions, 
if any, the top administration of X intends to take as a result of 
it. 

Good questionnaire. Good, relevant questions. Not enough 
questions about the Board of Trustees, who hold the bulk of power 
at this institution. 

The questionnaire mixes up the terms "college" and "institution." 
Some of the questions are clearly not appropriate to the law school 
or the school of manaoement. 

I answered questions as if they were being directed to the Law 
School and university administration, not to the college or 
management schools. 
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